My NLG Pipeline

My NLG Pipeline

Acquisition Newspaper3k Cleaning/Parsing Regex, NLTK, TextBlob, spacy  http://www.cbs.dtu.dk/courses/27610/regular-expressions-cheat-sheet-v2.pdf Remove non-alphanumeric character Convert to lowercase Spell-check Standardize spelling (e.g. kewl = cool) Tokenizers Words Remove irrelevant words (e.g. URLs) Sentences? NER Players, teams, etc. Lemmatization Part-of-speech tagging? Representation One-hot encoding N-grams TF-IDF word2vec, word2tensor Low explainability GloVE, CoVe Dimensionality reduction LSI, LSA, LDA Analysis Keyword extraction…

Responsive Design

Responsive Design

Tips Design a website for mobile users first, then adapt for larger screens Use Chrome “Device Mode” or Firefox “Responsive Design Mode” Responsive iframe What about the height?

Topics Of Interest

Topics Of Interest

AI Natural Language NLG Neural Networks Architectures: http://www.asimovinstitute.org/neural-network-zoo/ GAN Generating Images: https://opendatascience.com/blog/gans-explained-generative-adversarial-networks-applied-to-generating-images/ RNN TensorFlow: https://www.tensorflow.org/tutorials/recurrent AI Weirdness FAQ: http://aiweirdness.com/faq Examples of NLP Pipeline Exploratory http://pavel.surmenok.com/2016/11/05/natural-language-pipeline-for-chatbots https://github.com/hundredblocks/concrete_NLP_tutorial/blob/master/NLP_notebook.ipynb TensorFlow https://github.com/sherjilozair/char-rnn-tensorflow https://github.com/v1n337/tf-generative-model https://github.com/ChenChengKuan/SeqGAN_tensorflow https://github.com/UFAL-DSG/tgen Keras http://adventuresinmachinelearning.com/keras-lstm-tutorial/ PyTorch https://github.com/spro/practical-pytorch/blob/master/char-rnn-generation/char-rnn-generation.ipynb Evaluation metrics: https://github.com/Maluuba/nlg-eval Deep Learning with Python: https://github.com/fchollet/deep-learning-with-python-notebooks Deep Neural Networks with Keras and TensorFlow: https://github.com/leriomaggio/deep-learning-keras-tensorflow Generative Models: http://www.deeplearningbook.org/contents/generative_models.html Paper…