Ticket #2057 (new defect)

Opened 10 years ago

Last modified 11 months ago

1bit errors in files

Reported by: Richard.Kralovic Owned by: openmoko-devel
Priority: normal Milestone:
Component: unknown Version:
Severity: normal Keywords: file corruption, 1bit errors
Cc: riso@… Blocked By:
Blocking: Estimated Completion (week):
HasPatchForReview: PatchReviewResult:
Reproducible: rarely

Description

After some time of usage, I notice 1 bit errors in some binaries/libraries (affected application crashes, restarting the application does not, help, of course). Files are correct after rebooting Neo again; even without reflash.

I experienced this bug with different distributions (FSO, ASU...) and different kernels (downloaded Om2008.9-gta02-20080916.uImage.bin, custom built uImage-2.6.24+git0+a1e97c611253511ffc2d8c45e3e6d6894fa03fa3-r1.01-om-gta02.bin, etc.).

There is no relevant information in dmesg output. I also added warning messages to the software ECC correcting code (drivers/mtd/nand/nand_ecc.c) to the custom build kernel, but none of them appeared in dmesg.

The bug is hard to reproduce on demand, but usually occurs after several hours/days of usage.

Observed file corruption was always a single bit flip from 0 to 1, at offset 0x????0c2 or 0x????8c2 of the affected file, e.g. as follows:

< 00008c0: 0200 0200 0000 0000 0300 0300 0100 0000 ................
---

00008c0: 0200 2200 0000 0000 0300 0300 0100 0000 ..".............

Attachments

memtest.c (1.1 KB) - added by Richard.Kralovic 10 years ago.
memtest.log (560 bytes) - added by Richard.Kralovic 10 years ago.

Change History

Changed 10 years ago by Richard.Kralovic

Changed 10 years ago by Richard.Kralovic

comment:1 Changed 10 years ago by Richard.Kralovic

Ok, it looks like a hardware bug in ram. I run attached simple memory testing application and it indeed found 1 bit errors... I just hope I'll be able to get a replacement...

comment:2 Changed 10 years ago by cedric.berger

if you have to live with faulty ram, I guess "badram" might help.
http://rick.vanrein.org/linux/badram/
I did not check this since a while ago. But I do not think it is yet included in standard kernel ?

comment:3 Changed 10 years ago by andy

It's the same bit wrong in both the memtest and the error seen in the actual file too. I would contact your vendor about it for a replacement. 64MB of the RAM is in the CPU module, the other 64MB is external, it's quite possible then half the physical memory is fine and half is broken. As you allocate more virtual memory, it might start to use the second, broken half after some time.

comment:4 Changed 10 years ago by Richard.Kralovic

Thank you very much for your replies. I have just realized that there is also builtin memtest in uboot, but I am not able to figure out correct address ranges for gta02 (the default ranges just crash neo). What is the correct way of running the uboot memtest?

comment:5 Changed 10 years ago by andy

Hum seems U-Boot doesn't take care of its own memory footprint for the memory test, I found I could run it in two halves missing a critical bit out...

mtest 30000000 33c00000
mtest 34000000 38000000

comment:6 Changed 10 years ago by Richard.Kralovic

Thanks. I still had problems running mtest on full 34000000 38000000 range, but 34100000 37e00000 works fine. After few hours, mtest found the bad bits, too:

GTA02v6 # mtest 34100000 37e00000 55555555
Pattern 555555DD Writing... Reading...
Mem error @ 0x351000C0: found 55B5560D, expected 5595560D
Mem error @ 0x351198C0: found 55B5BC0D, expected 5595BC0D
Mem error @ 0x351278C0: found 55B5F40D, expected 5595F40D
Mem error @ 0x351360C0: found 55B62E0D, expected 55962E0D
Mem error @ 0x351398C0: found 55B63C0D, expected 55963C0D
Mem error @ 0x351440C0: found 55B6660D, expected 5596660D
Mem error @ 0x3515C0C0: found 55B6C60D, expected 5596C60D
Mem error @ 0x3515D8C0: found 55B6CC0D, expected 5596CC0D
Mem error @ 0x351620C0: found 55B6DE0D, expected 5596DE0D
Mem error @ 0x3516D8C0: found 55B70C0D, expected 55970C0D
Mem error @ 0x351758C0: found 55B72C0D, expected 55972C0D
Mem error @ 0x3517D8C0: found 55B74C0D, expected 55974C0D
Mem error @ 0x3517E0C0: found 55B74E0D, expected 55974E0D
Mem error @ 0x351CF8C0: found 55B8940D, expected 5598940D
Mem error @ 0x351E40C0: found 55B8E60D, expected 5598E60D
Mem error @ 0x351EC0C0: found 55B9060D, expected 5599060D
Mem error @ 0x351ED8C0: found 55B90C0D, expected 55990C0D
Mem error @ 0x351F00C0: found 55B9160D, expected 5599160D

So it definitely is bad sdram.

comment:7 Changed 10 years ago by andy

And as expected in the second half of it so in the external SDRAM chip. I think it is probably related that you had to trim the extent of the test as well, I did not have to do that. I would request a swapout from your vendor, I'm not sure how that's handled but it does seem to be a faulty device from our side.

comment:8 Changed 10 years ago by Vladimir.Koutny

I have a unit from the same (pulster.de) delivery as Richard and I don't see any memory issues (yet). However, I also can't run mtest in the full range - the range that doesn't cause crash/han
g is:

30000040 - 33e80000
34008000 - 38000000

(btw. first 0x40 bytes contains vector table - I guess you don't want to mtest that area :) )

That might be influenced by uboot version - in my case it is 1.3.2-rc2-dirty-moko12 (NAND) and 1.3.2-moko12 (NOR) (both as shipped), not sure where uboot code/data are mapped.

Btw., when looking at Freerunner memory map at http://wiki.openmoko.org/wiki/Neo_FreeRunner_Memory_Mapping, I would guess that external ram chip would be mapped starting at 38000000...

comment:9 Changed 10 years ago by werner

The external RAM is at 0x34..., using the variable bank 6/7 size feature.
See table 5-1 of the 2442 manual. Ignore the left-hand side of figure
5-1 :-)

comment:10 Changed 10 years ago by Vladimir.Koutny

Ok, thanks - clear now (I didn't check the specs before). I've updated the wiki accordingly.

comment:11 Changed 15 months ago by JustDox

Super Cialis With Dapoxine <a href=http://xenical.ccrpdc.com/xenical-prices.php>Xenical Prices</a> Generic Tamoxifen 20mg Viagra Rezeptfrei Osterreich <a href=http://cial5mg.xyz/order-cialis.php>Order Cialis</a> Nuova Propecia Effetti Collaterali Propecia Agente <a href=http://viag1.xyz/price-generic-viagra.php>Price Generic Viagra</a> What Does Cephalexin Cure Pour Propecia <a href=http://kama1.xyz/generic-kamagra-cheap.php>Generic Kamagra Cheap</a> Buy Orlistat 60 Mg With No Prescription Site Fiable Achat Cialis <a href=http://viag1.xyz/buy-25mg-viagra-online.php>Buy 25mg Viagra Online</a> Le Baclofene Contre L'Alcoolisme Best Pharmacies In Tijuana <a href=http://viag1.xyz/viagra-online-prices.php>Viagra Online Prices</a> Buy Doxycycline Online Uk Viagra Rezeptfrei Kaufen Apotheke <a href=http://kama1.xyz/cost-of-kamagra.php>Cost Of Kamagra</a> Tadalafil Professional 20 Mg Cephalexin Imha <a href=http://kama1.xyz/buy-generic-kamagra-online.php>Buy Generic Kamagra Online</a> Cialis Generico Acquisto Most providers will just need to see evidence of a regular income and also check your recent credit history to decide if they will lend to you. <a href=http://yourcashloan24.com>personal loan</a> and a final payment of. Even though a secured personal loan offers a cheaper interest rate not everyone may qualify for it.Philip Enloe is part of a group that could win two Grammy Awards. The PACE program enables property owners to finance the entire cost of energy and water efficiency and renewable energy upgrades to their homes and businesses and then repay those costs on their property tax bill.Levitra Generique Pharmacie <a href=http://zol1.xyz/cheap-zoloft-online.php>Cheap Zoloft Online</a> Cialis Comprar En Barcelona Purchase Dutasteride <a href=http://kamagra.ccrpdc.com/cheap-kamagra-no-rx.php>Cheap Kamagra No Rx</a> Viagra Tra I Giovani Advair <a href=http://kama1.xyz/where-to-order-kamagra.php>Where To Order Kamagra</a> Keflex Drug Information Pharmacy Canada Cialis <a href=http://strattera.ccrpdc.com/cheapest-strattera.php>Cheapest Strattera</a> Side Effects Amoxicillin In Canines Doctor To Prescribe Metformin <a href=http://cial1.xyz/need-to-order-cialis.php>Need To Order Cialis</a> Non Us Pharmacies Propecia Itch Hair Loss <a href=http://zol1.xyz/zoloft-online-cs.php>Zoloft Online Cs</a> Nuovo Farmaco Dapoxetina Buy Levitra 20mg Usa <a href=http://cial1.xyz/where-to-order-cialis.php>Where To Order Cialis</a> Misoprostol Mechanism Viagra Per Donne Esiste <a href=http://kama1.xyz/order-kamagra-in-usa.php>Order Kamagra In Usa</a> Dapoxetina 30 Clomid Et Fausse Couche <a href=http://zol1.xyz/fast-delivery-zoloft.php>Fast Delivery Zoloft</a> Cialis Montreal Kijiji Alli Availability 2014 <a href=http://doxycycline.ccrpdc.com/vibramycin-prices.php>Vibramycin Prices</a> Kamagra With Paypal Uk Cialis Lilly Precio <a href=http://viagra.ccrpdc.com/cheap-viagra-50mg.php>Cheap Viagra 50mg</a> Cialis Nuevo Caffergot For Sale <a href=http://cial1.xyz/buy-generic-cialis-online.php>Buy Generic Cialis Online</a> Buy Prednisone No Prescription Priligy Price Uk <a href=http://prednisone.ccrpdc.com/low-price-deltasone.php>Low Price Deltasone</a> Where to order real isotretinoin drugs on line Buy Levaquin Made In Usa <a href=http://zol1.xyz/order-zoloft-without-script.php>Order Zoloft Without Script</a> Amoxicillin 20 Mg Comprime Pellicule Boite De 8 Quand Commencer Nolvadex Apres Deca <a href=http://kama1.xyz/buy-kamagra-online.php>Buy Kamagra Online</a> Cialis 5 Mg Prontuario Fainting Amoxicillin <a href=http://cial5mg.xyz/buy-cheap-cialis-on-line.php>Buy Cheap Cialis On Line</a> Acquista Propecia Per Cialis Billig Rezept <a href=http://levitra.ccrpdc.com/best-price-on-levitra.php>Best Price On Levitra</a> Levitra Caratteristiche Alli Xenical <a href=http://cial5mg.xyz/cialis-online-buy.php>Cialis Online Buy</a> Buy Online Lasix Superdrugsaver In India <a href=http://cial1.xyz/cialis-online-prices.php>Cialis Online Prices</a> Cephalexin And Urinary Tract Infections Viagra Originale Senza Ricetta <a href=http://zol1.xyz/implicane-online.php>Implicane Online</a> Onlinee Pharmaciees Effetti Cialis 10 <a href=http://zol1.xyz/zoloft-generic-name.php>Zoloft Generic Name</a> Keflex Vision Dutasteride Overseas Mastercard Accepted <a href=http://kama1.xyz>Buy Kamagra</a> Finasteride 1mg Best Price How To Buy Colchicine Online With No Rx <a href=http://kama1.xyz/online-pharmacy-kamagra.php>Online Pharmacy Kamagra</a> Comprare Viagra Online Forum Karasahr Medication <a href=http://cial1.xyz/cialis-prices.php>Cialis Prices</a> 50 Mg Amatriptyline Cheap 40mg Levitra <a href=http://cial1.xyz/cialis-cost.php>Cialis Cost</a> accutane online australia Clobetasol Purchasing Cod Accepted <a href=http://cial5mg.xyz/cialis-online-buy.php>Cialis Online Buy</a> Precio Levitra Farmatodo Silagra Brand Name Viagra Cumwithuscom <a href=http://kama1.xyz/buy-cheap-kamagra-pills.php>Buy Cheap Kamagra Pills</a> Dangers Of Buying Viagra Online Propecia Dependency <a href=http://priligy.ccrpdc.com/buy-dapoxetine-priligy-online.php>Buy Dapoxetine Priligy Online</a> Priligy Andorra Precio Levitra Mejor Que Cialis <a href=http://kama1.xyz/buy-kamagra-jelly-online.php>Buy Kamagra Jelly Online</a> Tooth Abcess And Amoxicillin Procurer Du Viagra Sans Ordonnance <a href=http://zol1.xyz/sertraline.php>Sertraline</a> Keflex Dosage For Uti Cialis 10mg Enough <a href=http://zol1.xyz/zoloft-online-cs.php>Zoloft Online Cs</a> Pharmacy Rx One 60 Mg Cialis Levitra Senza Ricetta Generico <a href=http://kama1.xyz/purchase-generic-kamagra.php>Purchase Generic Kamagra</a> Prix Du Viagra Belgique Companies That Sell Cialas <a href=http://zol1.xyz/buy-cheap-zoloft.php>Buy Cheap Zoloft</a> Cialis Acquistp Propecia Soluzioni <a href=http://cial5mg.xyz/order-cialis-online-usa.php>Order Cialis Online Usa</a> Cialis Sales Buy Propecia In Ontario <a href=http://cial5mg.xyz/buy-generic-cialis-online.php>Buy Generic Cialis Online</a> Worldwide Bentyl Secure Discount Cialis Generika Preiswert <a href=http://cial1.xyz/buy-cheap-cialis-site.php>Buy Cheap Cialis Site</a> Pharmacies That Ship To The Us

comment:12 Changed 12 months ago by Abrahammaime

cialis kuala lumpur

<a href="http://cialisgsaa.com/">buy cialis online</a>

o efeito do cialis dura quanto tempo

<a href=http://cialisgsaa.com/>generic cialis online</a>

comment:13 Changed 11 months ago by RalphCleks

fast cialis delivery

<a href="http://cialisxrm.com/">Loragot</a>

girl taking cialis

<a href=http://cialisxrm.com/>cialis coupon</a>

comment:14 Changed 11 months ago by FelipeBuh

buy cialis

<a href="http://canadianpharmacyrxbsl.com/">canadian online pharmacies</a>

online discount pharmacy

<a href=http://canadianpharmacyrxbsl.com/?furosemidum>furosemidum</a>
canada pharmacies online pharmacy
<a href="http://canadianpharmacyrxbsl.com/?doxycycline-monohydrate-100mg">doxycycline monohydrate 100mg</a>

comment:15 Changed 11 months ago by Matthewderma

canadian pharmacy viagra brand

<a href="http://canadianpharmacyrxbsl.com/">canadian pharmacy</a>

online canadian discount pharmacy

<a href=http://canadianpharmacyrxbsl.com/?doxycycline-dosage>doxycycline dosage</a>
prescription drugs online without
<a href="http://canadianpharmacyrxbsl.com/?metoprololo">metoprololo</a>

comment:16 Changed 11 months ago by FelipeBuh

medication costs

<a href="http://canadianpharmacyrxbsl.com/">canadianpharmacyrxbsl.com</a>

no prescription pharmacies

<a href=http://canadianpharmacyrxbsl.com/?sertraline-side-effects>sertraline side effects</a>
pharmacies in canada
<a href="http://canadianpharmacyrxbsl.com/?metformin-hcl">metformin hcl</a>

comment:17 Changed 11 months ago by GeraldRok

compare prescription prices

<a href="http://canadianpharmacyrxbsl.com/">online canadian discount pharmacy

</a>
mexican pharmacies online

<a href=http://canadianpharmacyrxbsl.com/?best-time-to-take-metoprolol-extended-release>best time to take metoprolol extended release</a>
trust pharmacy canada
<a href="http://canadianpharmacyrxbsl.com/?is-prednisone-a-steroid">is prednisone a steroid</a>

Note: See TracTickets for help on using tickets.