A bioinformatics expert system linking functional data to anatomical outcomes in limb regeneration

Abstract
0

Amphibians and molting arthropods have the remarkable capacity to regenerate amputated limbs, as described by an extensive literature of experimental cuts, amputations, grafts, and molecular techniques. Despite a rich history of experimental effort, no comprehensive mechanistic model exists that can account for the pattern regulation observed in these experiments. While bioinformatics algorithms have revolutionized the study of signaling pathways, no such tools have heretofore been available to assist scientists in formulating testable models of large‐scale morphogenesis that match published data in the limb regeneration field. Major barriers to preventing an algorithmic approach are the lack of formal descriptions for experimental regenerative information and a repository to centralize storage and mining of functional data on limb regeneration. Establishing a new bioinformatics of shape would significantly accelerate the discovery of key insights into the mechanisms that implement complex regeneration. Here, we describe a novel mathematical ontology for limb regeneration to unambiguously encode phenotype, manipulation, and experiment data. Based on this formalism, we present the first centralized formal database of published limb regeneration experiments together with a user‐friendly expert system tool to facilitate its access and mining. These resources are freely available for the community and will assist both human biologists and artificial intelligence systems to discover testable, mechanistic models of limb regeneration.

Introduction
1

The regeneration of amputated limbs is one of the most striking examples of the restoration of a functional and complex structure (Birnbaum and Alvarado 2008). It is still largely unknown why some animals can regenerate large sections and complete appendages while others have a very limited regenerative capacity (Brockes and Kumar 2008). Organisms such as salamanders, frog tadpoles, and molting arthropods can regenerate complete limbs after amputation at any level (Maruzzo et al. 2005; Stocum and Cameron 2011; King et al. 2012). Understanding the mechanisms that permit these animals to restore lost limbs will pave the way for applications in the context of regenerative medicine to address human injury (Whited and Tabin 2009; Levin 2011). To this end, the field of regenerative biology has produced an extremely rich dataset of experiments based on classical surgical methods together with new molecular techniques and genetic tools. These various perturbations of the regenerative process result in a vast variety of morphological outcomes. Salamander limbs having multiple hands (Tank 1981), crab chelipeds composed of multiple claws (Nakatani et al. 1998), and cockroach limbs with intercalary multiple regenerates (French 1976a) are typical experimental results found in the literature.

2

Despite this large and ever‐growing dataset of regenerative limb experiments, there is no comprehensive mechanistic model that can explain how the correct (or incorrect) limb patterning occurs (Nacu and Tanaka 2011); the signaling mechanisms that regulate the process in which an amputated limb regenerates exactly the missing parts are unknown (Bryant et al. 2002). The latest advances in molecular pathways are identifying genes and molecules necessary in the regenerative process: molecular interference with certain elements causes a malfunction in the regenerative mechanism (Stocum and Cameron 2011). However, this is far from a comprehension of how regeneration is accomplished. Indeed, we need to identify the sufficient mechanisms that allow the repairing and regrowth of a missing limb. This profound disconnect between high‐resolution data at the molecular level and large‐scale anatomical outcomes is holding back the development of biomedical applications to control and translate the outstanding regenerative capacity that these organisms possess. Progress on the human biomedicine of limb injury requires that we formulate algorithmic models that unambiguously show how overall limb shape results from cell behaviors, because these will most clearly indicate where perturbations can be applied to trigger specific patterning events.

3

One of the main reasons for the lack of comprehensive models of limb regeneration is precisely the huge amount of raw functional and molecular resources found in the literature. Although great efforts in sequencing genetic information have produced important centralized transcriptomic, genomic, and epigenetic datasets on limb regeneration (Habermann et al. 2004; Putta et al. 2004; Durica et al. 2006; Guerrero et al. 2006), the field currently lacks any tools for mining the enormous published dataset on the most important aspect of regeneration: the endpoint – repair of large‐scale anatomical shape. The absence of formal analytical tools for functional data causes the paradox that, the larger the dataset becomes, the less we understand the studied system (Lazebnik 2002). Indeed, we have surpassed the threshold where a single person can keep track of all the information distributed in all the papers in the field; students entering this fascinating field are frustrated that no single repository exists which can be queried to determine what experiments have been done and what the outcomes of a specific perturbation were. Moreover, the data are now so rich that it is all but impossible for human experts to propose mechanistic models whose predictions match even a basic subset of the known results. Lastly, the emergent systems‐level pattern formation arising from cells following simple rules is often highly nonlinear and complex. The need to store and mine results of the regeneration literature, as well as the need to simulate models to determine their patterning properties, both converge on an unavoidable fact: the necessity of extending bioinformatics tools beyond molecules to morphology, so that computational tools can help human scientists discover models whose behavior fits the known facts of regeneration (Lobo et al. 2012).

4

Here we take the first essential step of this fundamental roadmap and produce a database that will be used by computational tools and human scientists to check their models’ predictions against the known results of morphological experiments. Each hard‐won model formulated by investigation of gene pathways is valuable to the extent that it predicts, explains, and helps control patterning processes. Our system connects the products of molecular and cell biology research with the known patterning properties of regeneration, enabling a new generation of tools for testing biochemical and genetic models against the existing published data.

5

A method to unambiguously encode biological shape is an essential part in a formalization of regenerative science. Natural language is imprecise and ambiguous (King et al. 2011), and a formal descriptive method is necessary to achieve semantic clarity. Ontologies define formal rules and logical connections to structure the knowledge of a particular domain (Bard 2003). They have extensively been applied to formalize scientific data in several biological fields, especially genetics (Soldatova and King 2005, 2006; Whetzel et al. 2006; Visser et al. 2011). Ontologies have also been applied to formalize phenotype data (Robinson and Mundlos 2010; Schindelman et al. 2011) and have been used in structured databases linking genetic and phenotypic data (Groth et al. 2007; Eppig et al. 2012; Yook et al. 2012). However, these ontologies describe phenotypes with predefined attributes, such as “enlarged heart” or “pericardial edema” (Smith and Eppig 2009), or associate predefined entities (“eye”, “tail”) with predefined qualities (“small”, “round”) (Beck et al. 2009; Washington et al. 2009; Mungall et al. 2010). Although attribute‐based ontologies are a great improvement over natural language descriptions, they are not adequate for the formalization of regenerative appendages. A regenerated limb consists of one of many possible topological and geometrical relationships between the segments that compose the morphology. For example, grafting experiments can result in limb morphologies with two or three hands, each of them with a variable number of digits, that may be located in the wrist or ectopically in the elbow. At the same time, highly detailed morphometric data can often obscure the important aspects of a morphological outcome among rich quantitative measurements of irrelevant or highly variable properties of individual animals.

6

Previously, we designed and successfully applied a new kind of mathematical ontology for the formalization of planarian regenerative experiments (Lobo et al. 2013a,b). This ontology overcomes the challenge of representing regenerative phenotypes by using mathematical graphs. Mathematical graphs have been extensively used for modeling and analyzing pattern representations (Conte et al. 2004) and biological phenomena (Mason and Verwoerd 2007) including morphological data (Nagl 1979; Doi 1984; Lobo and Vico 2010; Bard 2011; Lobo et al. 2011). In contrast to attribute ontologies, a mathematical graph can represent the topological relations between parts, as well as their geometrical and spatial relations (Pach 1999). In addition, a mathematical formalization of regenerative phenotypic data can be extended to formalize manipulation data. Cuts, amputations, and grafts and their combinations are difficult to express in natural language. In contrast, specific mathematical formalisms can be used to precisely and unambiguously define the complex manipulations typically used in regenerative experiments (Lobo et al. 2013b). This new kind of ontology based on mathematical graphs is an ideal approach for the formalization of limb phenotypes and manipulations.

7

Here, we report a novel ontology system for the field of limb regeneration. We designed an intermediate, symbolic representation based on graphs that highlights the key features of anatomy and facilitates comparison between experiments. Our optimal level of abstraction allowed us to include several very diverse model species in this analysis − a must if deep, general principles of shape regulation are ever to be discovered. Based on this novel ontology, we created an expert system database and query tool for this rich field. This system is the first, essential step in the effort of enabling powerful artificial intelligence tools to mine functional data and derive testable models explaining them.

Results
8

The knowledge base for the expert system on limb regeneration must contain all of the experimental perturbations performed in the past experiments, with their corresponding patterning outcomes. The first step for any knowledge base approach (for human or computerized analysis) is to define a formalism in which to describe the data. In order to fill a database with the published results in this field we defined formal descriptors of limb morphologies and of experimental actions.

Formalism for limb morphologies
9

In order to unambiguously characterize the morphology of limbs of regenerative organisms, we propose a mathematical formalism based on labeled graphs. A graph is a formal representation of a set of interconnected objects, represented with vertices and edges (links between vertices). The proposed formalization follows the natural division of a limb morphology into segments: each limb segment is represented by a graph edge, and edges are interconnected by joints represented as graph vertices. In this way, edges and vertices represent the segments and their joints in a limb morphology. The geometric characteristics of the limb morphology are stored as labels in the vertices and edges. The formalism is powerful enough to be applied to different types of limbs from a wide set of species, which we have grouped into different categories. Figure 1 shows a wild‐type morphology of a representative organism for each category currently present in the database along with its formalization represented as a schematic diagram and a cartoon. These categories currently include salamanders, frogs, crustaceans, insects, and arachnids (Fig. 1A−E, respectively).

10

Graph edges (blue lines with a center label, Fig. 1A′−E′) represent limb segments, and they are labeled with the type of segment that they represent. Each category contains a set of limb segments characteristic of that group of organisms. For example, the salamander and frog forelimbs include upper arm, fore arm, and hand segments (Fig. 1A′), whereas their hindlimbs include thigh, shank, and foot segments (Fig. 1B′). In contrast, crustaceans have a larger set of limb segments, including coxa, basis, ischium, merus, carpus, propus, and dactyl (Fig. 1C′). In addition to the segment type, a graph edge is labeled according to its geometrical parameters (distance and angle between its vertices), its side (left or right), and whether it is reversed (a 180° rotation around the proximal−distal axis) or inverted (swapping the natural proximal and distal segment ends). Segment nerves can be defined in the formalism by a sequence of consecutive locations outlining the path of the nerve. Finally, salamander and frog limb categories can include for each segment the number of bones and digits that are present. Digits are specified according to their position with respect to the segment they are attached to and the number of bones, including metacarpal or metatarsal bones and phalanges (cyan dots, Fig. 1A′, B′).

11

Graph vertices represent joints between segments (blue dots, Fig. 1A′−E′), and can be connected to one, two, or more edges. The length of a segment is defined as the distance between its two joints and is stored as an edge label, while segment shapes are abstracted as a list of numerical parameters and stored as a vertex label. The shape parameters represent the distance between the center of the joint and the limb morphological border in a specific direction (red dots, Fig. 1A′−E′). Joints have a parameter per each bisector of every two consecutive segments, except joints connected to a single segment, which have three parameters corresponding to the fixed angles of +90°, +180°, and +270° with respect to the direction of the segment. In this way, the size and shape of a segment are defined by a combination of the segment length parameter and its joints’ shape parameters. Therefore, the formalism can encode limbs with similar shape but different size (same joint shape parameters but different segment length parameters) and limbs with similar size but different shape (same segment length parameters but different joint shape parameters).

12

The formalism can encode any limb morphological configuration. Any segment topology can be represented, since a graph can decompose the plane (or a volume) in any arbitrary configuration. This property makes the formalism complete (universal): all possible wild‐type and experimental morphologies are representable. A limb morphology graph is always connected (a path always exists between any two segments). Wild‐type morphologies can always be represented by linear graphs (Fig. 1), where the most proximal and distal vertices connect to one segment and the in‐between vertices connect two edge segments. In contrast, grafting experiments can result in limbs with three or more segments attached to the same vertex, or a segment attaching directly to another segment. Figure 2 shows a selection of encoded limb morphologies that result from experiments found in the scientific literature, including limbs with arbitrary ectopic structures, such as digits, hands, or full limbs. In addition to the morphological configuration, the formalism can accommodate the shapes of the segments of a multitude of structures, such as crustacean chelipeds (as a combination of propus, fixed finger, and dactyl segments) or insect claws (pretarsus segments).

13

In addition to the graph diagram to visualize formalized morphologies, we implemented a simple algorithm that automatically draws a cartoon representation given an encoded morphology. Figures 1A′′−E′′ and 2 show automatically generated cartoon illustrations of the corresponding morphologies. Segments are color‐encoded according to their type, and the limb shape and topological configuration are derived from the connectivity and parameters stored in the formal encoding. When appropriate, bone silhouettes are included to aid the identification of different segments. In this way, the most important characteristics of a limb morphology, such as segment configuration and overall shape, are clearly and unambiguously specified and illustrated with the presented formalism.

Formalism for limb manipulations
14

Alongside the limb morphology descriptors, we propose a formalism to precisely and unambiguously encode the manipulations performed in a limb regeneration experiment. The techniques most used in this field include surgical, genetic, pharmacological, and irradiation interventions. We have formalized these interventions as the following possible basic actions: remove: a section of the limb is cut and discarded, keeping the rest of the limbcrop: a section of the limb is cut and kept, discarding the rest of the limbjoin: two sections from two different limbs are grafted togetherrelocate: a section from a limb is cut and grafted in a different part of the same limbreverse: a limb is reversed before being graftedirradiate: a section of the limb is irradiated.

15

When entering an experiment into the database, these basic actions are defined with specific parameters, such as a polygon to define the borders in the case of a “remove” action or the grafting position and angle of rotation in the case of a “join” action. Simple incisions can also be encoded as a “remove” action with two points as parameters, unambiguously defining the location and length of the surgical cut.

16

Basic actions are usually combined together during the procedure of a typical experiment. The formalism encodes the order of the individual actions in a manipulation using a mathematical tree. A mathematical tree represents a hierarchical graph structure, where the vertices represent a basic manipulation action or the initial limb morphology from which to start the experiment and the edges specify the order of the application of the manipulations. All basic manipulation actions receive an input (a limb to manipulate) and produce an output (a manipulated limb or amputated limb part), except the join action, which receives two inputs (a host limb and a piece to graft to) and produces an output (the limb with the grafted piece). Remove, crop, relocate, and irradiate actions are labeled with a list of spatial points defining a polygon that defines the area of the limb affected. A relocate action, in addition to the cut polygon, is labeled with a displacement vector and rotation angle of the graft coming from the same limb. Similarly, a join action is labeled with a displacement vector and rotation angle of the graft, but, in this case, the graft is obtained from another limb. A mathematical tree can then interconnect these basic actions and specific morphologies (encoded according to the formalism for morphologies presented above) to form any possible complex manipulation for an experiment.

17

Figure 3 illustrates the formalization of a typical manipulation from a salamander regeneration experiment where an amputated hand is grafted into a cut upper arm. The top two vertices in the figure (the leaves of the tree) specify the starting limbs for the experiment. In this example, the two wild‐type forelimbs of the salamander are used: left (left‐top vertex) and right (right‐top vertex). The manipulation then proceeds by amputating the left limb at the middle level of the upper arm. This basic action is encoded with a remove action (left vertex) that receives the wild‐type left limb as input and defines a polygon (yellow dots) selecting the section to amputate and discard. In addition, the manipulation amputates the hand of the right limb. This is encoded with a crop action (right vertex) that receives the wild‐type right limb as input and specifies with a polygon (yellow dots) the limb section (the hand in this case) to amputate and preserve for the next step. Finally, the manipulation takes the amputated hand from the right limb and grafts it into the amputated upper arm from the left limb. This final action is specified in the formalism with a join action that receives the outputs of the previous remove and crop actions. The join action is labeled with the proper position vector and rotation angle of the graft with respect to the host. The result of the join action (the root of the tree) represents the final configuration of the manipulation, which regeneration outcome will be scored in the corresponding experiment.

18

Figure 4 shows a selection of formalized manipulations curated from the scientific literature. Amputations can be performed to large areas, such as the whole hand, or smaller sections, such as a part of a bone or a single digit. Similarly, grafts transplanted to a limb can comprise several limb segments or just the distal cap of the limb. Irradiation exposures are usually applied to limb parts that are amputated and grafted into a non‐irradiated limb. Nerve manipulations are frequent in amphibian limb experiments, including complete denervation of a major nerve (formalized with remove actions) and major nerve deviations (formalized with relocate actions). In summary, all types of amputations, grafts, and subtle manipulations, including nerve deviations, partial irradiations, and incisions, can be unambiguously encoded with the presented formalism.

Formalism for limb regeneration experiments
19

The formalization of experimental manipulations and their resulting morphologies are combined together to create a complete formalism to describe any regenerative experiment. A specific experiment from a published study is then described with its relevant details, including a manipulation and a set of morphological outcomes. In the database, an experiment is encoded with the presented formalism with the following information: a descriptive unique name, the publication describing the results, the organism species, any treatments used (such as pharmacological compounds in the medium or injected), the formalized manipulation, and the formalized resultant morphologies.

20

A manipulated limb can present different phenotypes at different regeneration times. In addition, different animals can regenerate different phenotypes with the same treatment, resulting in different phenotypes at the same regeneration time (incomplete penetrance). Accordingly, the formalism can capture multiple resultant phenotypes for a single experiment, due to different regeneration times or treatments with incomplete penetrance. In particular, an experiment in the formalism includes a set of morphologies grouped by the time period at which they appear since the manipulation time‐point. For each recorded time period, the formalized experiment stores the total number of animals used (N) and the frequency distribution of each resultant morphology. In this way, formalized experiments can encode any combination of phenotypes at multiple regeneration times. Published experiments reporting only aggregated data (e.g., the total number of segments regenerated in a set of individuals) instead of the frequency of the resultant phenotypes are listed in the database with a label called “Aggregated data” to indicate that the frequencies are not exact but estimated.

Database of limb regeneration experiments
21

We modeled and implemented the presented formalism for limb experiments in a relational database. Figure 5 shows a diagram of the database schema, including the tables and their logical relations as defined in the database. The database is organized around the organism categories (center), which currently contains entries for salamander, frog, crustacean, insect, and arachnid. Around the center category, the rest of the tables in the database store the information about morphologies (blue area), manipulations (green area), and experiments (red area). The relations between the tables (arrows) ensure a consistent and optimal organization of the data.

22

Following this database schema, we manually curated a centralized database with all the limb regeneration experiments reported in a selection of primary papers from the scientific literature. Table 1 summarizes the publications included in the current version of the database, including their category, species used in the experiments, number of total experiments, average penetrance (the mean number of different phenotypes obtained per experiment and regenerative time) and the type of manipulative actions used (cuts, intralimb and extralimb grafts, pharmaceutical treatments, and irradiations).

23

We are maintaining the centralized database of limb experiments, which is freely available on the web (http://limbform.daniel‐lobo.com). We are continuously expanding the database with recent and classic papers. In addition, we invite the community to encode their own published experiments and submit them through the same website for inclusion in the centralized database. After some standard checks for consistency and redundancies, the new published experiments will be rapidly included and distributed in an updated version of the centralized database.

Software tool
24

We have designed and implemented a stand‐alone software tool to create, read, and analyze databases of limb regeneration experiments. The software tool is called Limbform (Limb Formalization), and it can be used to work with our curated database of limb experiments as well as with anyone's personal database created with the program or following the presented database schema. Limbform presents a user‐friendly graphical interface that allows any scientist to query, input, and easily search the large database of regeneration experiments, manipulations, and morphologies curated in the centralized database.

25

The software tool Limbform is freely available on the web (http://limbform.daniel‐lobo.com), and it has been specifically designed to interact with the centralized database of experiments. With the software tool and database together, a researcher can easily access and analyze a large selection of regenerative experiments published in the last century. The search functionality included in the tool facilitates the search of specific experiments across all the experiments included in the database. For example, typing a specific drug or gene name into the search module will list all the experiments (including descriptive names, manipulation procedures, and morphological diagrams) related to the drug or gene from any of the publications included in the database. Numerical queries are also possible, such as searching morphologies with a specific number of segments, joints, or digits. Indeed, the combination of the database and software tool represents a complete expert system of limb regeneration experiments. In addition, a user can also use the software tool to expand the database or create new personal databases containing custom experiments.

Discussion and Conclusion
26

We propose here the first ontological formalism to mathematically encode limb regenerative experiments. Based on this formalism, we created the first centralized database of limb regeneration experiments curated from the scientific literature of both vertebrate and invertebrate organisms. To facilitate access to the database, we created a software tool for the creation, mining, and analysis of databases of limb regenerative experiments. While other variants may be developed in the future, it is clear that some such scheme is necessary if bioinformatics tools are ever to be developed to leverage the growing mountain of data into constructivist, useful models. Our system is the first proof‐of‐principle effort in this direction, and is modular so that each aspect can be independently altered and improved upon by future users.

27

The formalism to encode limb phenotypes and their experimental manipulations is based on mathematical graphs. We did not include in the current formalism information regarding the detailed shape of individual limbs. Instead, a series of parameters define the overall shapes of limb segments, ignoring detailed features that greatly differ even among wild‐type limbs. Indeed, the first comprehensive models of limb regeneration constructed based on our formalism and curated data should focus on getting the correct large‐scale bodyplan anatomy and predicting the outcomes of functional perturbation, regardless of fine‐grain detail and individual variability that can add irrelevant noise to the dataset. In contrast to the textual phenotypic representations of classical ontologies, a mathematical graph unambiguously represents a phenotype at different information levels, including logical (merus vs. carpus), topological (foot connected to shank), and geometrical (length of a segment) information. Graph‐based phenotypes can be mathematically analyzed, compared, and mined, not only by scientists but also by automatic algorithms. This aspect takes the current system beyond a standardized repository of knowledge in this field to a first step towards computer‐assisted search for mechanistic models that explain the functional data. The ability of artificial intelligence tools to access and automatically analyze this dataset will pave the way for the application of new bioinformatics tools to mine the experimental knowledge on limb regeneration. Importantly, our formalism allows the seamless inclusion of regenerative data from very different model systems, allowing scientists and data mining algorithms to look for deep (not just species‐specific) patterns in these data.

28

We implemented a database schema based on the presented formalism and curated the first centralized database of limb regeneration experiments published in the scientific literature. The database unambiguously stores all the relevant details of the experiments, including publication, species, treatments, manipulations, and the reported statistical phenotype results. However, we found important information missing from some published papers, including the number of animals used, penetrance of the treatments, or ambiguous phenotype descriptions using natural language. In these cases of unknown information, we opted to input default values: N = 1 for the number of animals used, uniform distribution for penetrance, and a special “other” morphology for unknown or very ambiguously reported phenotypes. The database comprises a large selection of limb‐regenerating organisms, such as salamanders, frogs, insects, crustaceans, and arachnids, and it is freely available online for download. We are continuously expanding the centralized database and distributing new versions online with the most recent published experiments. As the database grows with the addition of further classic papers and new studies, its power to constrain and inform model‐building efforts will likewise increase.

29

We designed and implemented the software tool Limbform to facilitate the access and use of the centralized limb regeneration database. Anyone can download the freely available software tool and use it for searching specific experiments, extend the database with new experiments, or create new personal limb regeneration databases from scratch. The software presents an intuitive user interface based on graph diagrams and automatically generated cartoon representations of limb morphologies. Importantly, the included search module can be used to find experiments, manipulations, phenotypes, and publications (including online links to the full text) with any desired characteristic from the hundreds of experiments curated in the database. For example, a user can easily list all leg phenotypes (from any species) regenerated after a treatment with retinoic acid.