Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Migrated to Confluence 4.0

...

The

...

BioQ

...

web

...

application

...

uses

...

several

...

relational

...

database

...

models

...

to

...

provide

...

documentation

...

and

...

query

...

tools

...

for

...

the

...

various

...

genomic

...

databases.

...

All

...

schemas

...

and

...

ER

...

diagrams

...

can

...

be

...

found

...

in

...

the

...

MySQL

...

Workbench

...

document

...

on

...

our

...

Subversion

...

server.

...

Contents

Table of Contents
excludeContents

The core relational model

This entity-relationship (ER) diagram shows the core relational model for our database documentation (from subversion revision 70).

Image Added

The biologic-experiment-result

...

(BERT)

...

relational

...

model

...

Our

...

BERT

...

relational

...

model

...

is

...

designed

...

to

...

document

...

a

...

genomic

...

database

...

by

...

tracing

...

the

...

experimental

...

source

...

of

...

the

...

data.

...

The

...

key

...

entities

...

in

...

the

...

models

...

are

...

the

...

biologics,

...

the

...

experiments

...

and

...

the

...

experimental

...

results

...

as

...

illustrated

...

in

...

the

...

following

...

diagram.

Image Added

In the model, the tables in a relational database are grouped into flow groups that can input, output or reference material for the various experiments and processes that determined the data. Here is an example from our BioQ web application of the BERT model being applied to linkage disequilibrium (LD) data from the HapMap database. In BioQ, the diagram is interactive and can be used to navigate documentation and query the actual data.

Image Added

The following ER diagram shows the relational database implementation of the BERT model (from subversion revision 70, see the MySQL Workbench file ).

Image Added

The queries model

This is our model for storing queries in the documentation database.  This information is used to populate the BioQ queries for each database.

 Image Added

Tables

db, tbl and col

These provide descriptions of database, tables and columns, respectively, in the BioQ genomic databases.

db_refs, tbl_refs and col_refs

Bibliographic references.

Web links.

flow_group

In the BERT model, a flow group is a group of tables that can be input or output for a specific process.

Image Added

flow_group_tables

The tables in a flow group.

Image Added

flow_group_tags

Tags that describe a flow group. These are not the same as filters.

process

A process in the BERT model.

Image Added

process_flow_group

A group of tables, columns and/or databases which are input/output for a process or experiment in the BERT model. It's possible to have multiple groups with the same name for different processes. Each process must have a group and groups may be singletons.

 Image Added

process_tags

Tags that describe a process. These can also be used as filters. No entries as of version 70.

query

A query used in the BioQ web application.

 Image Added

query_column

This is used in Process.pm to look up information about columns being queried.

reference

Reference table showing things like Subversion revision number.

relationships

For recording and describing relationships between tables in genomic databases. No entries as of version 70.

results_tables

For each table with table_type='result',

...

determine

...

if

...

it

...

can

...

be

...

traced

...

to

...

subjects

...

and/or

...

biologics.

...

search_terms

...

Items

...

used

...

in

...

the

...

the

...

dbDoc

...

autocomplete

...

search

...

tool.

...

tags

Tags are used to group tables into categories. The 'tags'

...

table

...

contains

...

names

...

and

...

descriptions

...

of

...

the

...

tags.

...

tbl_tags

...

This

...

records

...

which

...

tags

...

go

...

with

...

which

...

tables.

...

Updating

...

the

...

documentation

...

schema

...

  1. Dump

...

  1. the

...

  1. existing

...

  1. database

...

    1. Use

...

    1. mysql

...

    1. --complete-insert

...

    1. --no-create-db

...

    1. --no-create-info

...

    1. --verbose

...

    1. See

...

    1. /projects/bioinf/ssaccone/dbdoc_util/dump_dbdoc_data.sh

...

  1. If

...

  1. necessary,

...

  1. create

...

  1. the

...

  1. schema

...

  1. file

...

  1. (current

...

  1. using

...

  1. MySQL

...

  1. Workbench

...

  1. with

...

  1. the

...

  1. file

...

  1. db_doc_model.mwb

...

  1. )

...

    1. The

...

    1. schema

...

    1. file

...

    1. is

...

    1. currently

...

    1. named

...

    1. db_doc_model.sql

...

    1. Note

...

    1. that

...

    1. the

...

    1. schema

...

    1. file

...

    1. should

...

    1. not

...

    1. have

...

    1. a

...

    1. 'USE'

...

    1. statement

...

    1. -

...

    1. instead

...

    1. use

...

    1. the

...

    1. dbdoc_util.pl

...

    1. dbdoc-db

...

    1. option.

...

  1. Run

...

  1. dbdoc_util.pl

...

  1. initdb

...

    1. You

...

    1. may

...

    1. also

...

    1. use

...

    1. the

...

    1. predefined

...

    1. script

...

    1. template_init.sh

...

    1. and

...

    1. the

...

    1. correpsonding

...

    1. options

...

    1. file

...

    1. template_init.opt

...

  1. Load

...

  1. the

...

  1. original

...

  1. dumped

...

  1. database

...

  1. See

...

  1. also

...

  1. the

...

  1. script

...

  1. /projects/bioinf/ssaccone/dbdoc_util/update_schema.sh

...

Initializing

...

documentation

...

for

...

a

...

single

...

database

...

This

...

is

...

used

...

to

...

take

...

an

...

existing

...

genomic

...

database,

...

such

...

as

...

HapMap,

...

and

...

set

...

up

...

entries

...

in

...

the

...

dbDoc

...

database

...

for

...

all

...

the

...

tables

...

and

...

columns

...

in

...

the

...

database.

...

This

...

will

...

ensure

...

that

...

entries

...

for

...

the

...

different

...

tables

...

and

...

columns

...

exist

...

so

...

that

...

more

...

detailed

...

documentation

...

can

...

be

...

added.

...

Example:

...

see

...

/projects/bioinf/ssaccone/hapmap/dbdoc/hapmap_p3r3_dbsnp132.sh

...

  1. Run

...

  1. dbdoc_util.pl

...

  1. initdoc

...

  1. (with

...

  1. options)

...

  1. to

...

  1. set

...

  1. up

...

  1. dbDoc

...

  1. for

...

  1. a

...

  1. specified

...

  1. existing

...

  1. genomic

...

  1. MySQL

...

  1. database

...

  1. Run

...

  1. dbdoc_util.pl

...

  1. updatedoc

...

  1. --dbdoc-xml-file=<file>

...

  1. to

...

  1. read

...

  1. XML

...

  1. documentation

...

    1. Suggestion:

...

    1. break

...

    1. up

...

    1. XML

...

    1. documentation

...

    1. into

...

    1. multiple

...

    1. files,

...

    1. such

...

    1. as

...

    1. a

...

    1. "core"

...

    1. file

...

    1. that

...

    1. does

...

    1. not

...

    1. change

...

    1. often,

...

    1. and

...

    1. a

...

    1. another

...

    1. file

...

    1. that

...

    1. might

...

    1. describe

...

    1. what

...

    1. the

...

    1. recent

...

    1. changes

...

    1. are.

...

    1. This

...

    1. is

...

    1. currently

...

    1. done

...

    1. for

...

    1. the

...

    1. HapMap

...

    1. databases.

...

Modifying

...

documentation

...

  • Deletions

...

  • :

...

  • at

...

  • the

...

  • moment

...

  • (subversion

...

  • 29)

...

  • a

...

  • row

...

  • can

...

  • be

...

  • deleted

...

  • from

...

  • the

...

  • db

...

  • table

...

  • and

...

  • this

...

  • will

...

  • propagate

...

  • throughout

...

  • the

...

  • database.

...

  • Updates

...

  • :

...

  • at

...

  • the

...

  • moment

...

  • (subversion

...

  • 29)

...

  • changes

...

  • do

...

  • not

...

  • cascade

...

  • well

...

  • due

...

  • to

...

  • a

...

  • circular

...

  • foreign

...

  • key

...

  • in

...

  • the

...

  • process/flow_group

...

  • tables.

...

  • To

...

  • change

...

  • the

...

  • name

...

  • of

...

  • a

...

  • database

...

  • the

...

  • docoumentation

...

  • should

...

  • be

...

  • re-loaded

...

  • from

...

  • XML.