Tag Archives: SAS

SAS CTO On IT And Big Data Analytics

By Gil Press, Contributor

“One of my biggest challenges,” Keith Collins told me recently, “is helping SAS understand how to communicate to IT organizations. We present workloads which look odd and different. IT does not know how to have an SLA (Service Level Agreement) around them.  We take all of the compute and I/O capacity that they can give us.” …read more

Source: FULL ARTICLE at Forbes Latest

SAS Institute, National Instruments top list of companies with good work-life balance

Sixteen of the top 25 companies offering a good work-life balance are technology companies, according to a new ranking from the job site Glassdoor, with the SAS Institute and National Instruments leading the pack.

The SAS Institute, which makes business analytics software for industries ranging from casinos to oil and gas providers, occupied the number-one spot on Glassdoor’s third annual ranking of the top companies for work-life balance, up from number four last year. National Instruments, which makes automated test equipment and virtual instrumentation software, was ranked second.

Other enterprise IT companies such as Slalom Consulting, Mentor Graphics, FactSet and Agilent Technologies also ranked high on the list. Other companies offering consumer services and products, like Yahoo, AOL, Nokia and MasterCard, were also named.

It is not surprising that SAS topped the list. The Cary, North Carolina-based company provides a dedicated work-life department staffed by eight full-time social workers who provide services to employees, for free, that include support services for child development, aging and elder care, and advising for the college search process.

To read this article in full or to leave a comment, please click here

…read more

Source: FULL ARTICLE at PCWorld

Soldiers die in heat wave trying for SAS

Two British soldiers died during a training exercise over the weekend as they took part in a gruelling selection process for the elite SAS unit on the hottest day of the year, military sources said on Monday.

Police and the Ministry of Defence (MoD) are investigating Saturday’s deaths in the Brecon Beacons mountain range in south Wales, while a third soldier remains in a serious condition in hospital.

Military sources said the men were members of the Territorial Army, Britain’s reservist force, who were hoping to join the elite Special Air Service (SAS) regiment.

The MoD refused to confirm media reports that the men collapsed from heat exhaustion while struggling through a tough selection process in temperatures of 29.5 degrees Celsius (85.1 degrees Fahrenheit).

“At this stage we are not ruling anything out,” a ministry spokesman told AFP.

It is understood that live ammunition was not involved in the incident.

An unnamed army officer told the Daily Mail newspaper: “The troops are desperate to prove they are up to joining the SAS and push themselves harder and harder.

“There is going to be a huge inquiry into what happened because, on the face of it, these lads look like they’ve been marched to death.”

The Brecon Beacons offer some of Britain’s most rugged terrain, and the mountain range is regularly used for military training exercises.

In January, an army captain also believed to have been trying out for the SAS was found dead on a snow-covered mountain in the Brecon Beacons.

An MoD spokesman said there were no plans to change “routine exercises” in light of the latest deaths in the mountains.

…read more

Source: FULL ARTICLE at Fox World News

Replace a whole line with "#"

By saeed.soltani

how can i replace the whole line which start with a specific pattern such as “???”, with a desired string such as “#” i.e:

in-file:

Code:

TAB 20120201 21:02:02
MRD 20121301 22:21:01
??? 201 256
SAS 20123010 12:25:41
MMT 20120102 11:01:12
POP 20120306 02:01:01
??? TAV 2021 333


out-file:

Code:

TAB 20120201 21:02:02
MRD 20121301 22:21:01
#
SAS 20123010 12:25:41
MMT 20120102 11:01:12
POP 20120306 02:01:01
#


Source: FULL ARTICLE at The UNIX and Linux Forums

Mentor Graphics Delivers Simulation and Emulation Solutions to Verify Serial Attached SCSI Products

By Business Wirevia The Motley Fool

Filed under:

Mentor Graphics Delivers Simulation and Emulation Solutions to Verify Serial Attached SCSI Products

WILSONVILLE, Ore.–(BUSINESS WIRE)– Mentor Graphics Corp. (NAS: MENT) , a leader in advanced system verification solutions, today announced hardware and software solutions to accelerate the verification of Serial Attached SCSI (SAS) second-generation (Gen2) products, having speeds up to 6Gbps. Using the Mentor® verification solutions, designers can test their SAS Gen2 devices integrated on their System-on-Chip (SoC) designs, and develop and test their software drivers and applications prior to silicon being available.

The first new product is iSolveTM SAS, which has a ‘plug-and-play’ hardware interface to the Veloce® family of hardware emulators. It provides a cost-effective and efficient solution to verify new SAS Gen2 target devices with their software drivers in a SoC design. Additionally, an emulated SoC containing a SAS initiator device, such as Host Bus Adapter, can be connected via the iSolve SAS solution to a full-speed SAS disk drive for testing with real target hardware. The Gen2 solution is also fully compatible with older Gen1 speed devices. This new hardware product adds to the existing iSolve family of solutions for the accelerated verification of applications such as storage, networking, embedded systems, wireless, and multimedia devices.

Complementing the iSolve solution is the SAS transaction-based verification IP (VIP) solution. This delivers both a simulation environment, using the Questa® verification platform, and accelerated simulation environment using the Veloce hardware for the verification of SAS Gen2-compliant devices. It generates the appropriate stimuli for the Design-Under-Test (DUT), passing packets, or transactions, of protocol data for tests. The VIP solution also provides a high-level Application Programming Interface (API) to allow use with multiple test-bench environments, such as SystemVerilog and SystemC, and provides example test environments that can exercise the emulated SAS Gen2 device. The Gen2 SAS VIP is also fully compatible with Gen1 speed devices.

Increased bandwidth and performance requirements of enterprise systems, especially those involving video streaming or high levels of transactional-data, such as reservation or billing systems, have meant that SAS has become an industry standard in the storage application space. Additionally, its backward compatibility with SCSI, and interoperability with Serial ATA (SATA), delivers flexibility and cost savings to enterprises previously not available using their traditional storage environments.

“The growth in SAS products has been increasing rapidly, and is especially important to those in sectors where large data-intensive storage is mandatory for the operation of applications,” said Eric Selosse, vice president and general manager, Mentor Emulation Division. “The challenges faced by the creators of such …read more

Source: FULL ARTICLE at DailyFinance

Virgin Atlantic Welcomes Chase Ultimate Rewards Cardholders Onboard

By Business Wirevia The Motley Fool

Filed under:

Virgin Atlantic Welcomes Chase Ultimate Rewards Cardholders Onboard

Chase Sapphire Preferred ® , Ink Plus ® and Ink Bold ® Cardholders Travel Worldwide in Comfort and Style with Newest Ultimate Rewards SM Point Transfer Partner

WILMINGTON, Del.–(BUSINESS WIRE)– Chase Card Services, a division of JPMorgan Chase & Co., today announced the addition of Virgin Atlantic, Richard Branson’s trans-Atlantic airline, as its newest Ultimate RewardsSM point transfer partner. A premier rewards program for cardholders that seek travel redemption alternatives that offer flexibility, ease and value, Ultimate Rewards‘ new partnership allows cardholders to redeem points for travel on Virgin Atlantic and experience its innovative service and style to London and destinations all over the world.

“We are thrilled that Virgin Atlantic‘s Flying Club has joined Ultimate Rewards,” said Jennifer Roberts, president, Affluent & High Net Worth, Chase Card Services. “With Ultimate Rewards, our cardholders will now enjoy added flexibility that allows them to transfer and combine points with Virgin Atlantic miles. Virgin Atlantic Flying Club Miles can be used for flights, upgrades and even unique experiences in the UK to make a trip even more memorable.”

Under this new partnership, Chase Sapphire Preferred®, Ink Plus® and Ink Bold® cardholders will now be able to instantly transfer Ultimate Rewards points to Flying Club, Virgin Atlantic‘s travel rewards program. Points are transferred at full value – meaning one Ultimate Rewards point is equal to one Flying Club mile.

“We’re looking forward to welcoming Chase customers onboard and know that they’ll love to redeem points for travel with Virgin Atlantic. We like to give our customers an extraordinary experience — whether it’s our complimentary food and drinks service, our award-winning inflight entertainment or our phenomenal cabin crew,” said Alan Lias, Head of Loyalty & Ancillary Revenue Development, Virgin Atlantic Airways. “In addition, the partnership is coming at an exciting time, as we begin our first UK domestic flights, allowing our passengers to seamlessly travel from London Heathrow, onto Edinburgh, Manchester and Aberdeen.”

Points can be transferred in increments of 1,000 and there are no limits to the number of points cardholders can transfer to Flying Club. Once transferred, points can be redeemed for travel and upgrades on Virgin Atlantic, or one of many travel partners, including Air China, Air New Zealand, Cyprus Airways, Gulf Air, Hawaiian Airlines, Jet Airways, Malaysia Airlines, SAS, Singapore Airlines, South African Airlines, Virgin America and Virgin Australia.

In addition to the point transfer benefit to Virgin Atlantic and other travel partners, eligible customers can use 20 percent fewer …read more

Source: FULL ARTICLE at DailyFinance

SAS and Teradata Recognized for Alliance Excellence, Market Impact

By Business Wirevia The Motley Fool

Filed under:

SAS and Teradata Recognized for Alliance Excellence, Market Impact

Analytics powerhouses honored for six years of success, innovative programs, growth

CARY, N.C. & DAYTON, Ohio–(BUSINESS WIRE)– The SAS and Teradata partnership has earned the 2013 ASAP Alliance Excellence Award in the Individual Alliance Excellence category, which is awarded by the Association of Strategic Alliance Professionals (ASAP), the leading professional association dedicated to elevating and promoting the profession of alliance management. The award acknowledged the partnership’s innovation, with continued growth and success over six years. Key accomplishments highlighted by ASAP include: governance structure, market impact and innovative programming, including tight R&D integration, the League of Analytic Heroes initiative and a joint Product Advisory Council.

“The SAS and Teradata alliance embodies the spirit of the Alliance Excellence Awards. It has been exemplary not just in terms of the great results it has achieved, but in how it has achieved them,” said Art Canter, President and CEO of ASAP. “The companies have displayed a high degree of collaboration, obtained strong support from their CEOs and adeptly aligned themselves across major functional areas, including project management, R&D, product management, marketing, services and technical support.”

More than 300 alliance professionals from around the world gathered on March 6 at ASAP‘s annual Alliance Excellence Awards Recognition Dinner in Orlando, FL, part of the 2013 ASAP Global Alliance Summit, the world’s largest annual gathering of the alliance management profession’s prominent organizations and thought leaders.

“This recognition within the alliance management community validates the hard work SAS and Teradata have invested into growing a multilayered and productive partnership for both companies,” said Elishia Rousos, CA-AM, Director of the SAS® Alliance.

ASAP cited the deep mutual technical engagement between the two companies. In 2012, Teradata (NYSE: TDC), the data solutions leader focused on big data analytics platforms and data warehousing, released an analytic appliance solely for use with SAS software – a first for the company. Business analytics leader SAS worked with Teradata to effectively port its software on the appliance and install it during the manufacturing process – likewise, an unprecedented move. The alliance has handled more than 400 customer engagements, netting more than 250 joint customer wins.

“Managing a business-technology partnership between two strong, independent companies like ours – who in fact are the leaders in their respective fields – requires an exceptional strategy, focused teamwork, agility and human commitment,” said Rick Lower, CA-AM, …read more
Source: FULL ARTICLE at DailyFinance

IceWEB Announces Significant Sale of Unified Storage Solution To County Government

By Business Wirevia The Motley Fool

Filed under:

IceWEB Announces Significant Sale of Unified Storage Solution To County Government

Company Continues Gaining Sales Momentum-

STERLING, Va.–(BUSINESS WIRE)– IceWEB, Inc.™ (OTC BB:IWEB), an award-winning Unified Data Storage appliance provider for cloud and virtual environments as well as the highly secure, scalable IceBOXPrivate Digital Cloud Solution, announced today that it has received an order from a county government for a complex IceWEB storage installation valued at $295,830. IceWEB worked with one of its national resellers to provide this solution to its customer.

For this sale IceWEB provided the customer with two SS-7000 IceWEB units and 720 Terabytes of Clustered Storage running on IceWEB’s patent-pending IceSTORM™ OS. The two systems feature 3 Terabytes of high-performance IceCACHE™ SSDs coupled with standard SAS drives, clustering and high availability failover between controllers for a tiered Unified Storage platform architecture. In addition, the systems feature both 1Gb and 10Gb connectivity options, advanced deduplication and intelligent replication capabilities.

“This significant sale illustrates that our company continues to move in the right direction with our sales model, our technology development and our partnerships. It’s an excellent win for the customer, the national reseller involved, and for us,” said Rob Howe, CEO of IceWEB.

“Our Sr. VP of Sales, Tim McNamee, has built excellent working relationships with multiple sales channels both regionally and nationally. Partnered with our reseller network, we provide highly-advanced IceWEB Unified Storage Solutions similar to the system provided for this exacting customer. Both our technology and our price-value equation met the customer’s requirements, and our team selling approach won the day. This is a clear validation that our technology, our sales model and our attention to customer requirements are all a good fit for complex data storage installations,” Howe said.

For more information please call 800-465-4637 or visit www.IceWEB.com. To become part of the Company’s e-mail list for industry updates and press releases, please send an e-mail to ir@iceweb.com.

This press release may contain forward-looking statements, which are made pursuant to the safe harbor provisions of the Private Securities Litigation Reform Act of 1995. In some cases you can identify those so-called “forward looking statements” by words such as “may,” “will,” “should,” “expects,” “plans,” “targets,” “believes,” “anticipates,” “estimates,” “predicts,” “potential,” or “continue” or the negative of those words and other comparable words. These forward looking statements are subject to risks and uncertainties, product tests, commercialization risks, availability of financing and results of financing efforts that …read more
Source: FULL ARTICLE at DailyFinance

Tech Makes Big Data Useful — Lots Of Data Analysts Still Needed — SAS

By Tom Groenfeldt, Contributor Although technology companies like Teradata and SAS are making data easier to use, business will need well-educated analysts for years to come, according to Jerry Oglesby, senior director for global academic and certification programs at SAS, the global analytics specialist. In my recent piece about Teradata Aster, I noted their assertion that new Aster tools could reduce the need for data scientists by 80 percent, using one to set up a function and then turn the operations over to business analysts. …read more
Source: FULL ARTICLE at Forbes Latest

SciQuest Strengthens Management Team With Appointments of Product-focused Executives

By Business Wirevia The Motley Fool

Filed under:

SciQuest Strengthens Management Team With Appointments of Product-focused Executives

Company Names Mark Digman as Vice President, Product Marketing & Strategy and Eric Zoetmulder as Vice President, Product Management

CARY, N.C.–(BUSINESS WIRE)– SciQuest (NAS: SQI) , the leading provider of cloud-based business automation solutions, today announced the appointment of two key executives to its management team. Mark Digman joins SciQuest as vice president, product marketing and strategy, bringing 20 years of product marketing, product management and sales experience, most recently with SAS Institute. The company also named Eric Zoetmulder vice president, product management. Eric has nearly 20 years of experience in product management, product marketing and professional services, and has been with SciQuest since 2006.

“I am extremely pleased to have Mark and Eric join our management team, as they will be instrumental in shaping our product portfolio and go-to market programs based on market opportunities and customer needs,” said Stephen Wiehe, president and CEO of SciQuest. “Coming off an extremely successful and vibrant company event at NextLevel, we know the expectations of our customers for us to deliver innovative products that meet their needs across all aspects of business automation are higher than ever. Mark and Eric will help ensure we continue our product excellence.”

Mark Digman is responsible for shaping the company’s product strategy, and working with SciQuest marketing, sales and customers to understand the market and develop relevant content and tools to support the buying cycle of SciQuest prospects. Before joining SciQuest, Digman was director of worldwide industry and solution product marketing at SAS Institute, where he was responsible for the planning, positioning, messaging and go-to market approaches of SAS solutions across industries. Digman joined SAS after serving as director of product marketing at ABC Technologies, the market leader in activity-based management (ABM) solutions, which was acquired by SAS. Earlier in his career, he was the vice president of sales and marketing for a leading value-added reseller (VAR) of mid-market enterprise resource planning (ERP) solutions in the Pacific Northwest.

Eric Zoetmulder is responsible for product management of the SciQuest business automation solutions. Previously, Zoetmulder held the positions of director of product marketing and director of supplier network services at SciQuest. He was instrumental in driving the company’s market expansion in higher education and the public sector, and was deeply involved in the recent product expansion and acquisitions of Upside Software and Spend Radar. Before SciQuest, Zoetmulder was senior director of information systems at …read more
Source: FULL ARTICLE at DailyFinance

UK conviction for jailed SAS sniper overturned

An elite British sniper jailed for illegally possessing a gun and ammunition has won an appeal to have his conviction overturned.

Sgt. Danny Nightingale of the Special Air Service admitted illegal possession of the 9mm Glock pistol and more than 300 rounds of ammunition at a court martial in November. He was sentenced to 18 months military detention, which was reduced to a 12-month suspended sentence on appeal.

The Court of Appeal quashed the convictions on Wednesday and ordered a retrial.

Lawyers for the 37-year-old, who has served in Afghanistan and Bosnia, had said that he was given the gun as a present by soldiers he helped train in Iraq, and that he had no intention to use it or the ammunition.

British law has strict controls on firearm ownership.

…read more
Source: FULL ARTICLE at Fox World News

KYOCERA Recognized for Excellence by Raytheon Space and Airborne Systems for Second Consecutive Year

By Business Wirevia The Motley Fool

KYOCERA Recognized for Excellence by Raytheon Space and Airborne Systems for Second Consecutive Year


3-Star Supplier Excellence Award Given to Less than One Percent of Raytheon SAS’ Supply Base

SAN DIEGO–(BUSINESS WIRE)– Kyocera America, Inc. was recognized by Raytheon Space and Airborne Systems (SAS) for Supplier Excellence in 2012, representing the company’s second consecutive 3-Star Supplier Excellence award. This honor acknowledges Kyocera’s performance in overall quality, on-time delivery, customer satisfaction, and total business and financial health.

The Supplier Excellence selection process is undertaken annually by SAS to determine those most exceptional suppliers who display consistent support for Raytheon’s critical Mission Assurance. Evaluation of supplier performance includes objective data as well as input from the Raytheon buyers and Material Program managers who deal with the suppliers regularly. The winning suppliers in 2012 represented less than one percent of Raytheon SAS‘ supply base.

Presentation of the 3-Star Excellence trophy was made by Raytheon Subcontracts Manager, Ron Uselton, to Rick Sigliano, vice president of North American Product Sales at the Kyocera facility in San Diego. “Kyocera America is honored to receive this prestigious award for the second year in a row, recognizing our employees for exceptional support to Raytheon and to our country’s service men and women,” said Sigliano. “Kyocera’s core philosophy of putting customers first is at the foundation of the company’s relationship with Raytheon. Kyocera is honored to provide continued program support to Raytheon SAS.”

About Kyocera

San Diego-based Kyocera America, Inc. (http://americas.kyocera.com/kai/semiparts) provides high-reliability ceramic packages, complex modules, and contract assembly services for numerous markets and applications, with customers in the U.S., Europe, and Asia. It is a wholly-owned subsidiary of Kyocera International, Inc., the North American holding company for Kyocera Corporation. Kyocera America employs over 400 people in its San Diego location and is part of the Semiconductor Components Group. http://americas.kyocera.com/kai/semiparts/index.cfm

Kyocera Corporation (NYS: KYO) (TOKYO:6971) (http://global.kyocera.com/), the parent and global headquarters of the Kyocera Group, was founded in 1959 as a producer of fine ceramics (also known as “advanced ceramics”). By combining these engineered materials with metals and plastics, and integrating them with other technologies, Kyocera has become a leading supplier of solar power …read more
Source: FULL ARTICLE at DailyFinance

Displaying log file pattern output in tabular form output

By Optimus81

Hi All,
I have result log file which looks like this (below): from the content need to consolidate the result and put it in tabular form

Code:

1). Intercomponents Checking
Passed: All Server are passed.
======================================================================
2). OS version Checking
Passed: All Server are passed.
======================================================================
3). Component registered and running check
Failed:VerifyComponent:D01A : Some Component Not RUNNING. ATS 0/1 :
Failed:VerifyComponent:C01A : Some Component Not RUNNING. MTD 0/1 :
======================================================================
4). Verify Server Connection, for ATS/MTD/IDT components
Failed:ConnectionCheck:D01A : Gateway fail to connect to SAS server!
Failed:ConnectionCheck:B01A : Gateway fail to connect to SCAD server: u-!
Failed:ConnectionCheck:A01A : Gateway fail to connect to CSEH server
======================================================================
5). Verify Service Availability, for Z2ZS or ZDS/ZDZ or IDX/MDX or ALRX
Failed:VerifyServiceAvailability:D01A: Service IDD is NOT up.
Failed:VerifyServiceAvailability:D01A: Service DD is NOT up.
======================================================================
6). Verify Component Resiliency
Failed:VerifyResiliency:SH01: Service IDD(45002): Only HH07A(274) provide the service IDD. Please check HH07B(275)
Failed:VerifyResiliency:BH01: Service EL: No service provided.
======================================================================
7). Verify RMCmon component
Passed: All Server are passed.
======================================================================
8). Checking the Core file
Failed:ddFileGenerated:CD01A : 1 : 1485297 Jan 7 11:11


i tried to use some grep command to print the output file content in tabular form

Code:

grep '^[0-9]).' outputfilename
grep -A 1 -B 1 '^[0-9]).' outputfilename // this command didn't work since it's not GNU version


tabluar form should look like :

Code:

|========================================|
| Consolidated Report Status |
|========================================|
|SI No CHECKS STATUS |
|========================================|
|1)Intercomponents Checking : Passed |
|----------------------------------------------------|
|2)OS version Checking : Passed |
|----------------------------------------------------|
|3)Component registered : Failed |
|----------------------------------------------------|
|4)Verify Server Connection : Failed |
|----------------------------------------------------|
|5)Verify Service Availability : Failed |
|----------------------------------------------------|
|6)Verify Component Resiliency : Failed |
|----------------------------------------------------|
|7)Verify RMCmon component : Passed |
|----------------------------------------------------|
|8)Checking the Core file : Failed |
|========================================|
| Total Passed : 2 |
| Total Failed : 5 |
| Total executed: 7 |
|========================================|


Source: FULL ARTICLE at The UNIX and Linux Forums

Solid-state storage hits 2TB

Flash storage vendor STEC is super-sizing the kind of flash storage used in smartphones and portable music players, coming out on Monday with 2TB SSDs in configurations for equipment vendors.

The SSDs (solid-state drives) being announced Monday can match many spinning hard disks for capacity, while their flash technology excels at speed and efficiency. Manufacturers will be able to build the drives into storage arrays or put them right into servers, depending on which type of interface they choose.

STEC ssd

Flash is moving closer to the mainstream of enterprise storage, with IT shops adopting it where they need fast access to data. The capacities of flash components are steadily growing, while some shortcomings that held the technology back are being overcome. STEC‘s new SSDs are made using MLC (multilevel cell) flash, the type used in consumer products, which is less expensive than earlier enterprise flash technologies.

STEC says its 2TB s840 SAS SSD and its 2TB s1120 PCIe Accelerator SSD make up the first family of 2TB flash parts with products for both types of interfaces. SAS is the typical interface for high-capacity hard drives in storage arrays, while PCIe is used in a growing number of flash components that attach directly to servers for fast access to heavily used data. STEC‘s new drives have roughly twice the capacity of its previous generation. They are being evaluated by system makers and will be available in February, the company said.

To read this article in full or to leave a comment, please click here

Source: FULL ARTICLE at PCWorld

Help me grep…..

By KashyapHi unix geeks,

I am a newbie to shell scripting.
I want to know how to match a particular string in a file and extract the matched string(s) into another file.

The input file say file1 is as shown,

Code:
1 line Changed paths: M /client/j2me/ce/sw/v.0/j2me/src/main/java/com/airone/cclient/j2me/database/RecordsList.java Pending Contact Count issue after SAS in Samsung 5230, 1 line Changed paths: M /client/j2me/ce/sw/v0/j2me/src/main/resources/mb/resources.xml Error message has changed for invalid pin. 1 line Changed paths: M /client/j2me/ce/sw/v.0/j2me/src/main/java/com/airone/cclient/mb/MF.java Samsung Wave S8500 UI changes
So each of the bold paths starts with /client.
Now i want to extract all the strings that start with /client ie.the highlighted strings, and i want to dump them in a seperate file.
The output is as shown ,
file2

Code:
/client/j2me/ce/sw/v.0/j2me/src/main/java/com/airone/cclient/j2me/database/RecordsList.java
/client/j2me/ce/sw/v0/j2me/src/main/resources/mb/resources.xml
/client/j2me/ce/sw/v.0/j2me/src/main/java/com/airone/cclient/mb/MF.java
Please help me out in achieving this.
Thanks,
Manju.
Source: The UNIX and Linux Forums

Converting data from one format to the other

Hi All,

I need to convert an exel spreadsheet into a SAS dataset,
and the following format change is needed. Please help, this is too complex
for a biologist.

Let me describe the input.

1st row is generation.1st column in keyword ‘generation’, starting 2nd column there are 5 generations in my actual data,
I have shown 3 here, namely G1,G2 and PAR.

2nd row is family name,1st column is keyword ‘gene’, from 2nd column format is NameParent1-NameParent2-RandomNumber_Replicate.
If ‘Parent’ is present in the name, then format is NameParent-Parent-RandomNumber_Replicate and it should be included in the output.
The characters upto the second ‘-‘ is the family name, replicate (can be 1,2 or 3) is the number after ‘_’.
Random number (between second ‘-‘ and ‘_’) can be ignored.

Starting 3rd row are gene names(column 1) and values(column 2 through 9).
There are 30000 genes in my actual data set.

The gene values need to repeat according to nested format shown below,
Only if the generation is PAR (stands for Parent), replace the generation ‘PAR‘ by name of the parent
specified by the characters upto first ‘-‘. For example if P1-Parent-9_1 is the column name and the
corresponding generation is PAR, the output should have ‘P1’ instead of ‘PAR‘ in the generations column.

Sample input

Code:
generation G1 G1 G1 G2 G2 G2 PAR PAR PAR PAR PAR PAR
gene P1-P2-24_3 P1-H-56_2 P1-P2-84_1 P1-P2-34_3 P1-P2-33_1 P1-P2-99_2 P1-Parent-9_1 P1-Parent-43_2 P1-Parent-45_3 P2-Parent-62_1 P2-Parent-43_2 P2-Parent-11_3
gene1 0 0 0 0 0 0 0 0 0 3 3 7
gene2 2 1 1 2 6 4 6 7 8 67 6 66
Expected Output

Code:
family rep generation gene value
P1-P2 3 G1 gene1 0
P1-P2 2 G1 gene1 0
P1-P2 1 G1 gene1 0
P1-P2 3 G2 gene1 0
P1-P2 1 G2 gene1 0
P1-P2 2 G2 gene1 0
P1-P2 1 P1 gene1 0
P1-P2 2 P1 gene1 0
P1-P2 3 P1 gene1 0
P1-P2 1 P2 gene1 3
P1-P2 2 P2 gene1 3
P1-P2 3 P2 gene1 7
P1-P2 3 G1 gene2 2
P1-P2 2 G1 gene2 1
P1-P2 1 G1 gene2 1
P1-P2 3 G2 gene2 2
P1-P2 1 G2 gene2 6
P1-P2 2 G2 gene2 4
P1-P2 1 P1 gene2 6
P1-P2 2 P1 gene2 7
P1-P2 3 P1 gene2 8
P1-P2 1 P2 gene2 67
P1-P2 2 P2 gene2 6
P1-P2 3 P2 gene2 66
Thanks
Source: The UNIX and Linux Forums