Productivity, Portability, Performance: Data-Centric Python

Keywords

Computer science, SPARK (programming language), Deep learning, Big data, Pipeline (software)

References

• Discriminating Gender on TwitterJohn D. Burger, John C. Henderson, George Kim — 2011
• Moving from Virtual Reality Exposure-Based Therapy to Augmented Reality Exposure-Based Therapy: A ReviewAnne Grete Kongsted, John Erik Hermansen — 2014
• Cross-project defect prediction: a large scale experiment on data vs. domain vs. processThomas Zimmermann, Nachiappan Nagappan, Harald C. Gall — 2009
• Learning Two-Branch Neural Networks for Image-Text Matching Tasks賢治 木村, 亜紀子 山形, 喜子 木田 — 2017
• Towards Automatic Discovery of Deviations in Binary Implementations with Applications to Error Detection and Fingerprint GenerationDavid Brumley, Juan Caballero, Zhenkai Liang — 2007
• Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlationDavid Powers — 2011
• Algorithms for Acyclic Database SchemesMihalis Yannakakis — 1981
• Groundswell, Expanded and Revised Edition: Winning in a World Transformed by Social TechnologiesCharlene Li, Josh Bernoff — 2011
• Classifying Political Orientation on Twitter: It's Not Easy!Raviv Cohen, Derek Ruths — 2013
• A survey of visualizations for high-dimensional data miningPatrick Hoffman, Georges Grinstein — 2001
• A Review on Web Pages Clustering TechniquesDipak Patel, Mukesh A. Zaveri — 2011
• The proof and measurement of association between two things. By C. Spearman, 1904.C. Spearman — 1987
• Political Polarization on TwitterMichael Conover, A. Ratkiewicz, Matthew Francisco — 2011
• Understanding Social TV: a surveyPablo César, David Geerts — 2011
• PathSimYizhou Sun, Jiawei Han, Xifeng Yan — 2011
• A Survey of Faceted SearchBifan Wei, Jun Liu, Qinghua Zheng — 2013
• Developing Affective Brand Commitment through Social MediaAnna M. Turri, Karen H. Smith, Elyria Kemp — 2013
• Persona Rights in Young People’s Labour of Online Cultural Production: Implications for New Media PolicyTamara Shepherd — 2012
• Exploiting YouTube: Contradictions of user-generated laborMark Andrejevic — 2009
• Body and Soul: The Black Panther Party and the Fight Against Medical DiscriminationTony Ward — 2014

Cited by

• Gear Training: A new way to implement high-performance model-parallel trainingHao Dong, Shuai Li, Dongchang Xu — 2018
• Democratizing Production-Scale Distributed Deep LearningMinghuang Ma, Hadi Pouransari, Daniel L. Chao — 2018
• A Review of Deep Learning with Special Emphasis on Architectures, Applications and Recent TrendsSaptarshi Sengupta, Sanchita Basak, Pallabi Saikia — 2019
• Addressing Skewness in Iterative ML Jobs with Parameter PartitionShaoqi Wang, Wei Chen, Xiaobo Zhou — 2019
• Resource Deflation: A New Approach For Transient Resource ReclamationPrateek Sharma, Ahmed Ali-Eldin, Prashant Shenoy — 2019
• PS2: Parameter Server on SparkZhipeng Zhang, Bin Cui, Yingxia Shao — 2019
• Benchmarking Deep Learning Hardware and Frameworks: Qualitative Metrics.Wei Dai, Daniel Berleant — 2019
• A Scalable Framework for Multilevel Streaming Data Analytics using Deep LearningShihao Ge, Haruna Isah, Farhana Zulkernine — 2019
• Machine Learning Pipelines with Modern Big Data Tools for High Energy PhysicsM. Migliorini, R. Castellotti, L. Canali — 2019
• NoC-based DNN accelerator: a future design paradigmKun-Chih Chen, Masoumeh Ebrahimi, Tingyi Wang — 2019
• Classification using Discriminative Restricted Boltzmann Machines on SparkMaria Varsamou, Theodore Antonakopoulos — 2019
• Scalable Video Classification using Bag of Visual Words on SparkNguyen Anh Tu, Thien Huynh‐The, Young-Koo Lee — 2019
• Analysis and Performance Evaluation of Deep Learning on Big DataKassiano J. Matteussi, Breno F. Zanchetta, Germano Bertoncello — 2019
• Cluster Pruning: An Efficient Filter Pruning Method for Edge AI Vision ApplicationsChinthaka Gamanayake, Lahiru Jayasinghe, Benny Kai Kiat Ng — 2020
• Distributed Feature Extraction on Apache Spark for Human Action RecognitionNguyen Anh Tu, Thien Huynh‐The, Kok‐Seng Wong — 2020
• TNT-KID: Transformer-based neural tagger for keyword identificationMatej Martinc, Blaž Škrlj, Senja Pollak — 2020
• Toward automatic comparison of visualization techniques: Application to graph visualizationLoann Giovannangeli, Romain Bourqui, Romain Giot — 2019
• Encrypted Blockchain DatabasesDaniel Adkins, Archita Agarwal, Seny Kamara — 2020
• Video Big Data Analytics in the Cloud: A Reference Architecture, Survey, Opportunities, and Open Research IssuesAftab Alam, Irfan Ullah, Young-Koo Lee — 2020
• COMPOSE: Cross-Modal Pseudo-Siamese Network for Patient Trial MatchingJunyi Gao, Cao Xiao, Lucas M. Glass — 2020

Related papers

• Big data anonymization with sparkYavuz Canbay, Şeref Sağıroğlu — 2017
• Big Data Analysis using Apache Hadoop and SparkDr.K. Sharmila, Dr.S Kamalakkannan, R. Devi — 2019
• SmarT: Machine Learning Approach for Efficient Filtering and Retrieval of Spatial and Temporal Data in Big DataSávio Salvarino Teles de Oliveira, Vagner J. S. Rodrigues, Wellington S. Martins — 2021
• Research on Big Data Computing Model based on Spark and Big Data ApplicationSida Chen — 2021
• HAIPipe: Combining Human-generated and Machine-generated Pipelines for Data PreparationSibei Chen, Nan Tang, Ju Fan — 2023
• Design of a Novel Modular Serial Pipeline Inspection RobotYixin Zhang, Hanli Chen, Lu Wang — 2023
• Development and Testing of a Field Applied Coating for High Temperature Cathodically Protected PipelinesRichard Norsworthy — 2003
• On Issues & Solutions of Separate System Drainage Pipeline DesignLV Ying-yong — 2013
• Three-Dimensional Numerical Simulation on Temperature Field of Crude Oil Pipeline and Products Pipeline Laid in One DitchHao Shi — 2011
• Impact of Oil Branch Pipeline Operation on Running Properties of Main PipelineWang Wen-w — 2015