Alpha Software Mobile Development Tools:   Alpha Anywhere    |   Alpha TransForm subscribe to our YouTube Channel  Follow Us on LinkedIn  Follow Us on Twitter  Follow Us on Facebook

Announcement

Collapse

The Alpha Software Forum Participation Guidelines

The Alpha Software Forum is a free forum created for Alpha Software Developer Community to ask for help, exchange ideas, and share solutions. Alpha Software strives to create an environment where all members of the community can feel safe to participate. In order to ensure the Alpha Software Forum is a place where all feel welcome, forum participants are expected to behave as follows:
  • Be professional in your conduct
  • Be kind to others
  • Be constructive when giving feedback
  • Be open to new ideas and suggestions
  • Stay on topic


Be sure all comments and threads you post are respectful. Posts that contain any of the following content will be considered a violation of your agreement as a member of the Alpha Software Forum Community and will be moderated:
  • Spam.
  • Vulgar language.
  • Quotes from private conversations without permission, including pricing and other sales related discussions.
  • Personal attacks, insults, or subtle put-downs.
  • Harassment, bullying, threatening, mocking, shaming, or deriding anyone.
  • Sexist, racist, homophobic, transphobic, ableist, or otherwise discriminatory jokes and language.
  • Sexually explicit or violent material, links, or language.
  • Pirated, hacked, or copyright-infringing material.
  • Encouraging of others to engage in the above behaviors.


If a thread or post is found to contain any of the content outlined above, a moderator may choose to take one of the following actions:
  • Remove the Post or Thread - the content is removed from the forum.
  • Place the User in Moderation - all posts and new threads must be approved by a moderator before they are posted.
  • Temporarily Ban the User - user is banned from forum for a period of time.
  • Permanently Ban the User - user is permanently banned from the forum.


Moderators may also rename posts and threads if they are too generic or do not property reflect the content.

Moderators may move threads if they have been posted in the incorrect forum.

Threads/Posts questioning specific moderator decisions or actions (such as "why was a user banned?") are not allowed and will be removed.

The owners of Alpha Software Corporation (Forum Owner) reserve the right to remove, edit, move, or close any thread for any reason; or ban any forum member without notice, reason, or explanation.

Community members are encouraged to click the "Report Post" icon in the lower left of a given post if they feel the post is in violation of the rules. This will alert the Moderators to take a look.

Alpha Software Corporation may amend the guidelines from time to time and may also vary the procedures it sets out where appropriate in a particular case. Your agreement to comply with the guidelines will be deemed agreement to any changes to it.



Bonus TIPS for Successful Posting

Try a Search First
It is highly recommended that a Search be done on your topic before posting, as many questions have been answered in prior posts. As with any search engine, the shorter the search term, the more "hits" will be returned, but the more specific the search term is, the greater the relevance of those "hits". Searching for "table" might well return every message on the board while "tablesum" would greatly restrict the number of messages returned.

When you do post
First, make sure you are posting your question in the correct forum. For example, if you post an issue regarding Desktop applications on the Mobile & Browser Applications board , not only will your question not be seen by the appropriate audience, it may also be removed or relocated.

The more detail you provide about your problem or question, the more likely someone is to understand your request and be able to help. A sample database with a minimum of records (and its support files, zipped together) will make it much easier to diagnose issues with your application. Screen shots of error messages are especially helpful.

When explaining how to reproduce your problem, please be as detailed as possible. Describe every step, click-by-click and keypress-by-keypress. Otherwise when others try to duplicate your problem, they may do something slightly different and end up with different results.

A note about attachments
You may only attach one file to each message. Attachment file size is limited to 2MB. If you need to include several files, you may do so by zipping them into a single archive.

If you forgot to attach your files to your post, please do NOT create a new thread. Instead, reply to your original message and attach the file there.

When attaching screen shots, it is best to attach an image file (.BMP, .JPG, .GIF, .PNG, etc.) or a zip file of several images, as opposed to a Word document containing the screen shots. Because Word documents are prone to viruses, many message board users will not open your Word file, therefore limiting their ability to help you.

Similarly, if you are uploading a zipped archive, you should simply create a .ZIP file and not a self-extracting .EXE as many users will not run your EXE file.
See more
See less

Update a field with the duplicte sequence number.

Collapse
X
 
  • Filter
  • Time
  • Show
Clear All
new posts

    Update a field with the duplicte sequence number.

    Is there a way to mark a field with the sequence number of the duplicates that were found during a "Mark Duplicate records" process?

    I need to mark a Dupe_Seq field with the sequence number of the duplicate group. I have a DBF file with 9.5 million records.

    Name record 1 = Don Seq number for this group = 1
    Name record25 - Don Seq number for this group = 2

    Any help would be appreciated.

    Jamie Powers
    Thank You,


    Jamie Powers
    Powers Data Resources

    #2
    Re: Update a field with the duplicte sequence number.

    There's nothing built in to Alpha to do that. Wouldn't be hard to write a short script to do it.

    What's the table name and the field names (and types) that define a duplication?
    Do you want to sequence stamp all duplicates in a group or just those following the first one in the group? If so, first in what order (record number or some other)?
    Last edited by Stan Mathews; 09-23-2016, 09:17 AM.
    There can be only one.

    Comment


      #3
      Re: Update a field with the duplicte sequence number.

      Table name: els_dedupe.dbf
      Field1 is Name (This contains the First & Last Name - This is the only field that I am using to determine the duplicate record.)
      Field2 is Dupe_Seq (this is the field that I want to mark with the sequence number. I want to stamp all duplicate records in record number order...lowest to highest.)
      Thank You,


      Jamie Powers
      Powers Data Resources

      Comment


        #4
        Re: Update a field with the duplicte sequence number.

        Give this a shot. Might want to backup first but it doesn't change anything except the dup_seq field so you can always run an update operation to reset that to zero if you need to.

        Code:
        seq = 0
        tbl = table.open("els_dedupe.dbf")
        tbl.order("name")
        match_name = tbl.name
        tbl.batch_begin()
        while .not. tbl.fetch_eof()
        	seq = seq +1
        	while (.not. tbl.fetch_eof()) .and. tbl.name = match_name
        		tbl.change_begin()
        		tbl.Dupe_Seq = seq
        		tbl.change_end()
        		tbl.fetch_next()
        	end while
        	match_name = tbl.name
        end while
        tbl.batch_end()
        tbl.close()
        end
        Assuming dup_seq is numeric and large enough to hold whatever number of duplicates that might be found.
        Last edited by Stan Mathews; 09-23-2016, 09:55 AM.
        There can be only one.

        Comment


          #5
          Re: Update a field with the duplicte sequence number.

          Thanks Stan. I am still testing this code. I will let you know how this works for me.
          Thank You,


          Jamie Powers
          Powers Data Resources

          Comment


            #6
            Re: Update a field with the duplicte sequence number.

            This presupposes that dupe identification is easy.
            It often isn't.
            You might want to check more than just the Name field.
            Example;
            Ted Giles, Giles Ted, Eddy Giles are potentially the same but not for certain.
            Ted Giles 01/01/1900 and Giles Ted 01/01/1900 probably are.

            Sorry, I do this on huge data sets when migrating squillions of records.
            See our Hybrid Option here;
            https://hybridapps.example-software.com/


            Apologies to anyone I haven't managed to upset yet.
            You are held in a queue and I will get to you soon.

            Comment


              #7
              Re: Update a field with the duplicte sequence number.

              Stan,

              Thank you for the code. This is marking all duplicate records for a group with the same number. I need to mark each duplicate in a group with a sequence number within that group then move to the next duplicate group and start the sequence for that group over from 1 and mark each duplicate within that group with a sequence number within that group...ect for all duplicate groups within the data file.

              The duplicate group is determined by the value in the Name field in my data file.

              Record Name Dupe_Seq
              1 Jamie 1
              1204 Jamie 2
              10004 Jamie 3
              5200 Powers 1
              21117 Powers 2
              45211 Powers 3

              The final step to my challenge is that if the number has already been used for a duplicate group then I need to skip that number and use the next available, un-used number.

              My customer has sent me the data with random numbers being used for each of the duplicate groups and this number is assigned for the lifetime of the record. (This is a Personalized URL "Purl" project.)
              Thank You,


              Jamie Powers
              Powers Data Resources

              Comment


                #8
                Re: Update a field with the duplicte sequence number.

                Misunderstood.

                This should do that.


                Code:
                seq = 1
                tbl = table.open("els_dedupe.dbf")
                tbl.order("name")
                match_name = tbl.name
                tbl.batch_begin()
                while .not. tbl.fetch_eof()
                	while (.not. tbl.fetch_eof()) .and. tbl.name = match_name
                		tbl.change_begin()
                		tbl.Dupe_Seq = seq
                		tbl.change_end()
                		tbl.fetch_next()
                		seq = seq +1
                	end while
                	match_name = tbl.name
                seq = 1
                end while
                tbl.batch_end()
                tbl.close()
                end
                There can be only one.

                Comment


                  #9
                  Re: Update a field with the duplicte sequence number.

                  Stan,

                  This last script that you posted worked perfectly. Thank you!

                  Jamie Powers
                  Thank You,


                  Jamie Powers
                  Powers Data Resources

                  Comment

                  Working...
                  X