Abstract
Optimization of cell engineering protocols requires standard, comprehensive quality metrics. We previously developed CellNet, a computational tool to quantitatively assess the transcriptional fidelity of engineered cells compared with their natural counterparts, based on bulk-derived expression profiles. However, this platform and others were limited in their ability to compare data from different sources, and no current tool makes it easy to compare new protocols with existing state-of-the-art protocols in a standardized manner. Here, we utilized our prior application of the top-scoring pair transformation to build a computational platform, platform-agnostic CellNet (PACNet), to address both shortcomings. To demonstrate the utility of PACNet, we applied it to thousands of samples from over 100 studies that describe dozens of protocols designed to produce seven distinct cell types. We performed an in-depth examination of hepatocyte and cardiomyocyte protocols to identify the best-performing methods, characterize the extent of intra-protocol and inter-lab variation, and identify common off-target signatures, including a surprising neural/neuroendocrine signature in primary liver-derived organoids. We have made PACNet available as an easy-to-use web application, allowing users to assess their protocols relative to our database of reference engineered samples, and as open-source, extensible code.