About
Data science, AI, big data, machine learning, statistical learning, social algorithms…
Articles by Eric
Activity
-
The network engineer who knew exactly why that switch fabric degraded under specific load patterns just retired. Nobody wrote it down. I'm seeing…
The network engineer who knew exactly why that switch fabric degraded under specific load patterns just retired. Nobody wrote it down. I'm seeing…
Liked by Eric Colson
-
Really enjoyed this conversation on the Berkeley Culture Kit podcast! Thank you to Jennifer Chatman and Sameer Srivastava for the thoughtful…
Really enjoyed this conversation on the Berkeley Culture Kit podcast! Thank you to Jennifer Chatman and Sameer Srivastava for the thoughtful…
Liked by Eric Colson
-
The last six years have probably been the most impactful for me based on the learning velocity -- not the kind where you hone your skills, but the…
The last six years have probably been the most impactful for me based on the learning velocity -- not the kind where you hone your skills, but the…
Liked by Eric Colson
Experience
Education
-
Stanford University
-
- Present
Activities and Societies: Stanford Industrial Affiliates
Masters Degree in MS&E with focus on Statistical Learning.
Advisor: Ramesh Johari
Research Topics:
* "Human‐Machine Systems to Leverage More Data", Directed Study with Professor Ashish Goel
* "The Benefits of Generalists over Specialists in a Dynamic Environment", Directed Study with Professor Bob Sutton -
-
-
-
Publications
-
Feature Selection and Validation for Human Classifiers
Association for the Advancement of Artificial Intelligence (www.aaai.org)
Algorithmic approaches to prediction and recommendation can often be improved by combining the results with the curation of human experts. Hybrid machine- human recommendation systems can combine the best of both large-scale machine learning and expert-human judgement. In this paper, we outline an approach for measuring, training, and understanding the human contribution to the combined system. This approach provides a practical strategy for optimizing the role and experience of the human…
Algorithmic approaches to prediction and recommendation can often be improved by combining the results with the curation of human experts. Hybrid machine- human recommendation systems can combine the best of both large-scale machine learning and expert-human judgement. In this paper, we outline an approach for measuring, training, and understanding the human contribution to the combined system. This approach provides a practical strategy for optimizing the role and experience of the human experts. We share a motivating example from Stitch Fix, an online personal styling service that commits to its recommendations through the physical delivery of merchandise to clients.
Other authors -
ETD: A Design Pattern for Building Web-Based Analytics Dashboards in R
The R User Conference 2014
ETD, an abbreviation for extract-transform-display, is a design pattern that the Stitch Fix data team
observed while building reporting and analytics dashboards in R, using the Shiny package. Formalizing
this pattern reduces the complexity involved in creating web-based dashboards. It also provides a
templatized approach for creating dashboards and promotes re-use and encapsulation of R and data
extraction code.
Developing interactive web-based dashboards typically…ETD, an abbreviation for extract-transform-display, is a design pattern that the Stitch Fix data team
observed while building reporting and analytics dashboards in R, using the Shiny package. Formalizing
this pattern reduces the complexity involved in creating web-based dashboards. It also provides a
templatized approach for creating dashboards and promotes re-use and encapsulation of R and data
extraction code.
Developing interactive web-based dashboards typically involves three distinct stages. First, the
‘Extract’ stage pulls data from a data source - typically a relational database using SQL. This extracted
data is pulled into an R data structure where complex calculations can be applied (e.g. cross-tabulation,
cleansing routines, conditional probabilities, complex metric definitions, …etc.). This is the
‘Transform’ stage. Finally, the transformed information is displayed using standard R visualization
packages like ggplot or googleVis. This is the ‘Display’ stage. This 3-staged workflow is analogous
to the extract-transform-load2
(ETL) pattern prevalent in data warehousing. The important distinction is
the final stage where, rather than loading the data for system consumption, we are rendering the
information for end-user consumption.
Many data scientists lack the requisite skills to build web-based analytics dashboards. However,
packages like Shiny provide a layer of abstraction that enables them to build web-based application in
R without having to learn HTML, Javascript and CSS. Our ETD design pattern takes it one step further
by taming the complexities of Shiny’s reactive programming framework and making it possible to
templatize the creation of typical analytics dashboards. Using the ETD pattern in the development of
Shiny dashboards helps our data scientists build complex web-based dashboards quickly while keeping
our R code-base modular, clean, and extensibleOther authorsSee publication -
Using Human and Machine Processing in Recommendation Systems
Association for the Advancement of Artificial Intelligence (www.aaai.org)
See publicationCustomer-item recommendation systems are used by many ecommerce companies. For this task, machine-learning algorithms are efficient at processing structured data for ranking vast catalogs of merchandise in the context of a customer. Yet, machines are notoriously challenged when it comes to processing unstructured data such as images and free-form text. Humans, on the other hand, can process unstructured data effectively. They can also better contextualize the results and perceive more nuanced…
Customer-item recommendation systems are used by many ecommerce companies. For this task, machine-learning algorithms are efficient at processing structured data for ranking vast catalogs of merchandise in the context of a customer. Yet, machines are notoriously challenged when it comes to processing unstructured data such as images and free-form text. Humans, on the other hand, can process unstructured data effectively. They can also better contextualize the results and perceive more nuanced distinctions vs. machines alone. However, human processing is inefficient on large sets of unranked items. By using the two resources together in a single system, more data and processing can be leveraged.
Projects
-
Human-in-the-loop machine learning, by Ted Cuzzillo
See projectWhat do you call a practice that most data scientists have heard of, few have tried, and even fewer know how to do well? It turns out, no one is quite certain what to call it. In our latest free report Real-World Active Learning: Applications and Strategies for Human-in-the-Loop Machine Learning, we examine the relatively new field of “active learning” — also referred to as “human computation,” “human-machine hybrid systems,” and “human-in-the-loop machine learning.” Whatever you call it, the…
What do you call a practice that most data scientists have heard of, few have tried, and even fewer know how to do well? It turns out, no one is quite certain what to call it. In our latest free report Real-World Active Learning: Applications and Strategies for Human-in-the-Loop Machine Learning, we examine the relatively new field of “active learning” — also referred to as “human computation,” “human-machine hybrid systems,” and “human-in-the-loop machine learning.” Whatever you call it, the field is exploding with practical applications that are proving the efficiency of combining human and machine intelligence.
-
Strata 2015: Data (art &) Science
See projectFor years now we’ve espoused data-driven decision making into the organization. And, while we still need to take this further, there is equal opportunity in internalizing the “art” that exists within the organization. The judgement and cultural values that reside within the brains of our employees can be harvested and married with data science to produce new capabilities. In this talk we will share new ideas about how to systematically combine the assets of the organization – be they machines…
For years now we’ve espoused data-driven decision making into the organization. And, while we still need to take this further, there is equal opportunity in internalizing the “art” that exists within the organization. The judgement and cultural values that reside within the brains of our employees can be harvested and married with data science to produce new capabilities. In this talk we will share new ideas about how to systematically combine the assets of the organization – be they machines or humans.
-
ACM Recsys 2014: Blending Human Computation and Machine Algorithms for Personalized Style Recommendations
See projectMachine algorithms are great for tasks that require processing of large amounts of objective and structured data. However, they have difficulty with tasks that are relatively simple for skilled humans – For example, interpreting concepts in an image, or discerning tone in language, ..etc. Yet, there is a class of problems that call for precisely the combination of these tasks. This concept of human-assisted algorithmic processing is not new. It is inherent to many processes that we are familiar…
Machine algorithms are great for tasks that require processing of large amounts of objective and structured data. However, they have difficulty with tasks that are relatively simple for skilled humans – For example, interpreting concepts in an image, or discerning tone in language, ..etc. Yet, there is a class of problems that call for precisely the combination of these tasks. This concept of human-assisted algorithmic processing is not new. It is inherent to many processes that we are familiar with. However, there are very few systems that embrace humans and machines as two resources within a single system. Instead, they are often independent and non-collaborating agents. In this talk, we explain how a single task-processing system can be architected to use diverse resources: be they human or machine. Such a system not only better utilizes each resource, but also produces better results and gets better with experience.
-
Fashioning Data: How fashion industry leaders innovate with data, By Julie Steele and Liza Kindred
The traditional cycle in the fashion industry starts on the runway, with designs that are finally available for consumer purchase several months later. But as this O’Reilly report shows, consumers are now an integral part of the full fashion cycle—even before some styles come to fruition—as fashion innovators find new ways to bring data analytics to the industry.
Through interviews with several fashion startups, authors Liza Kindred and Julie Steele reveal that these pioneers are talking…The traditional cycle in the fashion industry starts on the runway, with designs that are finally available for consumer purchase several months later. But as this O’Reilly report shows, consumers are now an integral part of the full fashion cycle—even before some styles come to fruition—as fashion innovators find new ways to bring data analytics to the industry.
Through interviews with several fashion startups, authors Liza Kindred and Julie Steele reveal that these pioneers are talking to customers and getting valuable data from them, in ways that other industries would be wise to emulate. Some aspects of fashion are becoming more agile, as startups such as Poshly, Rent the Runway, and Stitch Fix respond to customer input on sizing, preference, and more.
As you’ll discover, data science has already made big alterations to the $3 trillion fashion industry, via a growing number of fashion data tools and trends, including custom fit and local manufacturing. At the same time, there is lots of room for exploration and innovation, especially in the areas of machine vs human insight, image processing, and online vs offline data collection.
Liza Kindred is the founder of Third Wave Fashion, a fashion tech think tank, and the author of the upcoming O’Reilly book How We Buy Now.
Julie Steele is Director of Communications at Silicon Valley Data Science and coauthor of Beautiful Visualization and Designing Data Visualizations (both O’Reilly).Other creatorsSee project -
Strata 2013: "Committing to Recommendation Algorithms"
-
See projectDeveloping recommendation algorithms so accurate that we can commit to them.
Recommendations received
-
LinkedIn User
3 people have recommended Eric
Join now to viewMore activity by Eric
-
It was amazing to be back at Massachusetts Institute of Technology many years after being a research fellow and join MIT Technology Review for a…
It was amazing to be back at Massachusetts Institute of Technology many years after being a research fellow and join MIT Technology Review for a…
Liked by Eric Colson
-
I'm hiring a senior product data scientist on the Home Quality & Intelligence DS team at Google. With Gemini now powering Google Home, we are…
I'm hiring a senior product data scientist on the Home Quality & Intelligence DS team at Google. With Gemini now powering Google Home, we are…
Liked by Eric Colson
-
After nearly 10 years of building Literati, today marks a new chapter. We are thrilled to announce our acquisition by Trustbridge Partners, a…
After nearly 10 years of building Literati, today marks a new chapter. We are thrilled to announce our acquisition by Trustbridge Partners, a…
Liked by Eric Colson
-
WHAT? WOW! Thank you!! "Dear Melissa and Michael Bernstein, Congratulations! I am pleased to share that Flash Teams has been awarded a gold medal…
WHAT? WOW! Thank you!! "Dear Melissa and Michael Bernstein, Congratulations! I am pleased to share that Flash Teams has been awarded a gold medal…
Liked by Eric Colson
-
Unexpected but fun news that Flash Teams got picked up for a Chinese edition
Unexpected but fun news that Flash Teams got picked up for a Chinese edition
Liked by Eric Colson
-
The IT team at Stitch Fix’s San Francisco HQ are the unsung superheroes of our workday. When our laptops freeze five minutes before a deadline or the…
The IT team at Stitch Fix’s San Francisco HQ are the unsung superheroes of our workday. When our laptops freeze five minutes before a deadline or the…
Liked by Eric Colson
-
I’ve joined Google as a Data Scientist on the Applied AI team within Google Cloud. Over the last few years, I’ve become increasingly focused on the…
I’ve joined Google as a Data Scientist on the Applied AI team within Google Cloud. Over the last few years, I’ve become increasingly focused on the…
Liked by Eric Colson
-
Last week, we hosted Praveer Melwani, CFO at Figma, for a conversation with the Footwork portfolio. Praveer has been at Figma for nearly nine years…
Last week, we hosted Praveer Melwani, CFO at Figma, for a conversation with the Footwork portfolio. Praveer has been at Figma for nearly nine years…
Liked by Eric Colson
-
hackNY.org has spent 16 years building a community of technologists in New York City. This summer we're trying something new. The hackNY Public…
hackNY.org has spent 16 years building a community of technologists in New York City. This summer we're trying something new. The hackNY Public…
Liked by Eric Colson
-
I've been spending time across the US with college students & faculty. There's a theme: students can't get internships this summer. Not just a few…
I've been spending time across the US with college students & faculty. There's a theme: students can't get internships this summer. Not just a few…
Liked by Eric Colson
-
Week to remember! It’s incredible to have live data flowing through HomeCEO.AI ;) still waitlist https://lnkd.in/eW9zircW With live data, 3 AI…
Week to remember! It’s incredible to have live data flowing through HomeCEO.AI ;) still waitlist https://lnkd.in/eW9zircW With live data, 3 AI…
Liked by Eric Colson
-
After more than six incredible years as Chief Compliance Officer at HOYA Corporation, I’m excited to share that I’m starting a new chapter as a…
After more than six incredible years as Chief Compliance Officer at HOYA Corporation, I’m excited to share that I’m starting a new chapter as a…
Liked by Eric Colson
-
Announcing the 2026 hackNY Public Interest Lab! This initiative aims to partner talented technologists from the hackNY community with nonprofit and…
Announcing the 2026 hackNY Public Interest Lab! This initiative aims to partner talented technologists from the hackNY community with nonprofit and…
Liked by Eric Colson
Other similar profiles
Explore top content on LinkedIn
Find curated posts and insights for relevant topics all in one place.
View top contentOthers named Eric Colson
39 others named Eric Colson are on LinkedIn
See others named Eric Colson